-- Logs begin at Wed 2022-06-29 10:32:34 UTC, end at Wed 2022-06-29 11:52:28 UTC. -- Jun 29 11:15:56.333075 dv-cinder-847335-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 29 11:15:56.342247 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 11:15:56 2022] *** Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: nodename: dv-cinder-847335-2-iscsi Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: machine: x86_64 Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: clock source: unix Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: pcre jit disabled Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: detected number of CPU cores: 4 Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: current working directory: / Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: detected binary path: /usr/bin/uwsgi-core Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: your processes number limit is 47680 Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: your memory page size is 4096 bytes Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: detected max file descriptor number: 2048 Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: lock engine: pthread robust mutexes Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: thunder lock: enabled Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 29 11:15:56.345709 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 11:15:56.388662 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: Python main interpreter initialized at 0x5618a12ae9c0 Jun 29 11:15:56.388662 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: python threads support enabled Jun 29 11:15:56.388662 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: your server socket listen backlog is limited to 100 connections Jun 29 11:15:56.388662 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: your mercy for graceful operations on workers is 90 seconds Jun 29 11:15:56.389006 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 11:15:56.389081 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: *** Operational MODE: preforking *** Jun 29 11:15:56.389310 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: *** uWSGI is running in multiple interpreter mode *** Jun 29 11:15:56.389310 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: spawned uWSGI master process (pid: 103390) Jun 29 11:15:56.389501 dv-cinder-847335-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 29 11:15:56.390608 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: spawned uWSGI worker 1 (pid: 103391, cores: 1) Jun 29 11:15:56.390608 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: spawned uWSGI worker 2 (pid: 103392, cores: 1) Jun 29 11:15:56.390608 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 11:15:57.045728 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 11:15:57.052181 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 11:15:58.173401 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 11:15:58.173401 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: from cryptography.utils import int_from_bytes Jun 29 11:15:58.174077 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 11:15:58.174077 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: from cryptography.utils import int_from_bytes Jun 29 11:15:58.174873 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 11:15:58.174873 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: from cryptography.utils import int_from_bytes Jun 29 11:15:58.175328 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 11:15:58.175328 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: from cryptography.utils import int_from_bytes Jun 29 11:16:00.640871 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 11:16:00.641946 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 11:16:00.642156 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 11:16:00.642509 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 11:16:00.642758 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 11:16:00.643137 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.643454 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.643767 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.644105 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.644429 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.644736 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.645048 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.645358 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.645678 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.645929 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.646237 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.646554 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847335-2-iscsi {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.646866 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.647166 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.647280 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 11:16:00.647682 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.647766 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 11:16:00.647866 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.648068 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 11:16:00.648158 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.648379 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.648464 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 11:16:00.648658 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 11:16:00.648753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.649035 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.649152 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.649354 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.649595 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.649704 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.649896 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.649991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.650196 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.650295 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.650524 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.650639 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.650829 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.650925 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.651131 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.651230 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.651440 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.651536 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.651696 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.651784 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.652028 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.652127 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.652346 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847335-2-iscsi {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.652433 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.652657 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.652742 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847335-2-iscsi {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.652956 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.653050 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.653255 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.653349 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.653562 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.653648 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.653858 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.654009 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.654170 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.654311 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.654463 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.654612 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.654947 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.655039 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.655242 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.655344 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.655532 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.655638 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.655850 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.655947 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.656167 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.656251 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.656470 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.656578 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.656773 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.656970 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.657643 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.657824 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.657944 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.658032 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.658246 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.658338 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.658545 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.658633 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.658844 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.658929 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847335-2-iscsi {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.659145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.659263 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.659387 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.659515 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.659686 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.659817 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.660036 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.660241 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.660341 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.660563 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.660652 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.660851 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.660951 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.661115 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.661209 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.661425 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.661514 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.661738 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.661827 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.662038 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.662132 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.662338 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.662436 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.662637 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.662726 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.662935 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.663021 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.663230 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.663324 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.663524 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.663609 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.663822 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.663950 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.664142 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.664241 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.664439 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.664524 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.664735 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.664831 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.664977 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.665087 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.665278 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.665375 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.665589 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.665695 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.665900 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.666005 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.666196 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.666287 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.666443 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.666532 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.666687 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.666841 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.666998 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.667153 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.667310 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.667454 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.667609 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.667764 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.667930 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.668110 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.668230 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.668412 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.668528 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.668710 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.668831 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.669009 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.669129 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.669320 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.669416 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.669643 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.669732 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.669938 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.670025 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.670183 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.670278 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.670474 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.670589 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.670769 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.670887 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.671077 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.671197 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.671374 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.671582 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.671677 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.671840 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.671979 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.672144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.672271 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.672495 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.672610 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.672807 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.672895 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.673108 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.673209 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.673416 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.673503 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.673726 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.673814 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.674024 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.674120 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.674320 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.674407 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.674612 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.674698 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.674909 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.674996 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.675218 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.675324 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.675514 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.675609 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.675755 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.675922 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.676069 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.676167 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.676365 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.676452 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.676673 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.676767 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.676971 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.677065 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.677266 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.677360 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.677562 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.677649 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.677849 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.677946 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.678147 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.678243 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.678438 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.678525 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.678737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.678831 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.679031 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.679116 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.679325 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.679409 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.679619 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.679717 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.679927 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.680016 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.680224 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.680311 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.680519 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.680613 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.680827 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.680921 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.681139 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.681236 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.681430 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.681523 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.681725 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.681811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.682015 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.682112 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.682308 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.682404 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.682599 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.682693 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.682890 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.682977 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.683180 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.683276 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.683485 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.683572 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.683777 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.683904 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.684097 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.684192 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.684393 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.684479 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.684687 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.684780 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.684983 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.685078 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.685290 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.685377 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.685583 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.685708 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.685901 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.686007 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.686186 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.686282 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.686483 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.686586 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.686777 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.686871 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.687070 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.687180 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.687361 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.687463 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.687652 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.687750 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.687967 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.688088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.688285 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.688385 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.688579 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.688666 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.688872 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.688958 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.689178 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.689273 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.689488 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.689574 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.689786 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.689872 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.690084 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.690172 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.690381 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.690475 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.690691 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:16:00.690780 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.691002 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.691096 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.691309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.691401 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.691627 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.691713 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.691961 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.692063 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.692264 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.692351 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.692596 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.692691 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.692904 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.692992 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.693207 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.693294 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.693513 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.693600 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.693821 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.693909 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.694130 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.694215 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.694421 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.694517 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.694727 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.694831 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.695029 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.695132 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.695336 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.695439 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.695637 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.695719 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.695973 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.696075 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.696279 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.696382 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.696579 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.696665 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.696879 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.696971 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.697182 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.697288 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.697483 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.697580 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.697796 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.697939 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.698098 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.698201 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.698402 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.698487 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.698704 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.698798 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.699011 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.699101 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.699314 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.699400 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.699615 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.699701 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.699940 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.700032 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.700239 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.700325 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.700536 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.700622 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.700831 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.700926 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.701130 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.701218 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.701438 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.701536 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.701733 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.701822 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.702035 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.702120 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.702337 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.702436 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.702638 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.702723 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.702941 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.703027 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.703241 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.703336 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.703543 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.703632 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.704383 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.704474 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.704690 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.704788 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.704993 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.705087 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.705294 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.705383 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.705592 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.705757 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.705896 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.705986 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.706180 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.706268 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.706476 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.706573 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.706771 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.706859 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.707065 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.707152 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.707360 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.707457 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.707650 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.707747 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.707973 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.708063 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.708277 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.708366 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.708578 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.708672 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.708878 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.708970 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.709181 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.709275 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.709734 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.709828 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.710035 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.710135 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.710335 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.710423 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.710632 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.710726 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.710934 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.711034 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.711234 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.711329 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.711527 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.711614 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.711854 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.711957 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.712158 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.712246 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.712452 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.712536 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.712745 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.712839 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.713040 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.713127 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.713330 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.713415 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.713626 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.713719 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.713919 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.714013 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.714216 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.714304 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.714511 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.714609 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.714809 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.714903 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.715098 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.715184 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.715410 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.715499 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.715708 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.715803 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.716028 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.716122 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.716321 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.716410 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.716614 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.716702 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.716944 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.717042 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.717240 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.717339 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.717552 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.717641 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.717849 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.717946 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.718150 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.718237 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.718446 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.718532 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.718745 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.718840 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.719040 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.719127 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.719359 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.720006 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.720190 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.720295 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.720490 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.720579 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.720786 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.720874 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.721082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.721179 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.721379 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.721472 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.721686 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.721779 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.721982 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.722076 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.722278 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.722366 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.722571 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.722666 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.722865 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.722954 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.723166 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.723263 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.723472 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.723559 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.723802 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.723952 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.724149 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.724237 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.724457 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.724544 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.724773 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.724861 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.725074 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.725161 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.725378 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.725474 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.725677 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.725764 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.725976 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.726106 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.726275 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.726371 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.726578 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.726673 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.726887 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.726975 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.727187 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.727282 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.727495 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.727625 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.727793 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.727908 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.728131 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.728234 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.728431 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.728520 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.728743 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.728831 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.729037 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.729132 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.729340 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.729433 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.729659 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.729746 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.729980 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.730067 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.730279 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.730371 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.730584 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.730678 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.730883 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.730970 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.731182 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.731275 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.731479 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.731563 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.731777 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.731894 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.732098 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.732196 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.732396 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.732494 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.732697 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.732793 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.732997 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.733083 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.733295 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.733394 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.733596 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.733682 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.733890 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.733977 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.734310 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.734474 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.734559 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.734633 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.734784 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.734900 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.735100 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.735204 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.735405 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.735495 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.735720 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.735808 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.736058 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.736164 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.736349 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.736459 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.736659 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.736764 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.736954 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.737044 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.737252 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.737337 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.737555 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.737659 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.737855 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.737950 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.738147 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.738233 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.738439 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.738524 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.738735 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.738832 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.739037 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.739122 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.739338 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.739424 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.739637 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.739725 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.739965 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.740057 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.740268 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.740369 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.740564 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.740651 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.740861 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.740949 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.741159 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.741253 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.741460 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.741547 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.741763 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.741850 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.742069 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.742164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.742369 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.742467 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.742663 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.742748 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.742959 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.743055 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.743259 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.743345 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.743560 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.743655 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.743872 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.743962 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.744171 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.744271 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.744467 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.744556 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.744774 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.744871 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.745066 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.745154 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.745368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.745455 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.745674 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.745760 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.745986 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.746228 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.746315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.746553 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.746667 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.746862 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.746957 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.747159 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.747253 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.747469 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.747552 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.747776 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.747969 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.748104 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.748218 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.748410 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.748506 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.748721 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.748808 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.749025 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.749126 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.749322 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.749417 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.749621 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.749708 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.749917 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.750012 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.750216 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.750312 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.750513 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.751105 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.751335 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.751422 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.751628 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.751726 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.751950 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.752042 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.752248 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.752495 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.752583 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.752821 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.752918 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.753117 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.753211 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.753419 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.753516 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.753714 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.753801 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.754019 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.754106 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.754317 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.754412 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.754636 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.754725 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.754939 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.755037 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.755231 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.755329 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.755525 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.755614 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.755822 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.755950 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.756137 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.756226 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.756442 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.756539 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.756740 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.756867 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.757040 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.757135 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.757337 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.757426 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.757636 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.757739 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.757933 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.758109 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.758227 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.758315 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.758521 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.758617 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.758821 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.758918 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.759112 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.759205 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.759409 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.759497 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.759707 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.759805 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.760026 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.760117 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.760327 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.760413 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.760627 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.760723 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.760921 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.761007 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.761217 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.761305 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.761507 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.761606 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.761805 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.761893 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.762097 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.762184 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.762400 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.762490 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.762698 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.762785 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.762990 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.763085 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.763282 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.763378 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.763581 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.763670 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.763899 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.764002 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.764193 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.764290 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.764491 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.764578 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.764791 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.764888 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.765090 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.765187 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.765381 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.765476 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.765673 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.765767 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.765964 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.766050 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.766799 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.767010 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.767269 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.767499 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.767631 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.767755 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.767893 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.768049 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.768181 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.768317 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.768436 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.768557 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.768679 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.768804 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.768941 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.769042 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.769175 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.769291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.769466 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.769566 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.769764 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.769860 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.770059 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.770163 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.770355 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.770452 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.770653 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.770750 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.770944 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.771038 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.771238 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.771333 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.771533 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.771636 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.771841 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.771939 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.772140 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.772241 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.772433 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.772520 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.772727 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.772815 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.773018 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.773112 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.773310 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.773398 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.773603 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.773691 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.773908 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.774007 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.774204 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.774292 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.774494 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.774580 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.774788 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.774882 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.775078 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.775161 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.775377 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.775472 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.775689 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.775783 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.776019 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.776109 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.776315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.776402 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.776616 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.776705 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.777001 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.777100 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.777190 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.777272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.777489 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.777578 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.777787 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.777874 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.778080 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.778189 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.778374 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.778470 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.778670 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.778757 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.778964 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.779059 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.779257 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.779339 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.779554 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.779649 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.779866 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.779965 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.780168 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.780263 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.780463 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.780550 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.780757 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.780855 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.781074 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.781159 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.781370 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.781464 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.781673 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.781767 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.782034 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.782123 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.782344 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.782429 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.782645 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.782741 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.782947 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.783033 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.783246 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.783331 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.783549 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.783635 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.783862 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.784027 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.784186 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.784323 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.784478 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.784616 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.784750 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.784885 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.785020 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.785157 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.785379 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.785517 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.785661 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.785802 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.785949 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.786095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.786311 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.786445 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.786587 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.786722 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.786857 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.787000 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.787216 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.787357 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.787494 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.787638 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.787774 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.787954 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.788093 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.788238 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.788380 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.788515 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.788657 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.788801 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.788944 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.789080 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.789216 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.789373 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.789507 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.789602 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.789725 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.789814 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.790031 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.790119 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.790336 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.790433 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.790630 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.790717 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.790928 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.791036 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.791231 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.791327 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.791527 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.791615 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.791864 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.791956 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.792165 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.792263 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.792463 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.792551 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.792763 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.792852 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.793058 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.793155 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.793360 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.793456 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.793651 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.793750 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.793947 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.794063 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.794257 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.794351 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.794552 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.794648 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.794869 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.794964 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.795226 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.795316 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.795533 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.795640 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.795846 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.795937 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.796162 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.796261 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.796459 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.796556 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.796836 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.796922 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.797148 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.797244 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.797464 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.797562 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.797773 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.797868 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.798067 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.798156 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.798359 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.798447 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.798659 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.798747 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.798972 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.799059 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.799267 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.799356 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.799560 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.799655 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.799877 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.799970 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.800176 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.800264 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.800473 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.800558 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.800785 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.800886 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.801088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.801183 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.801401 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.801490 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.801763 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.801849 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.802105 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.802200 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.802407 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.802502 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.802719 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.802808 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.803036 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.803132 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.803332 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.803421 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.803627 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.803715 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.803950 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.804058 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.804251 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.804347 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.804547 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.804635 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.804860 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.804959 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.805156 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.805243 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.805461 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.805569 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.805766 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.805862 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.806060 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.806157 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.806352 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.806438 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.806646 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.806735 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.806959 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.807048 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.807255 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.807394 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.807572 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.807686 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.807896 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.808016 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.808211 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.808299 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.808523 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.808612 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.808821 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.808908 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.809135 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.809236 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.809436 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.809524 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.809733 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.809841 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.810024 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.810120 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.810314 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.810400 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.810625 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.810720 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.810923 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.811019 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.811228 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.811323 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.811531 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.811618 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.811850 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.811959 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.812144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.812241 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.812437 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.812527 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.812749 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.812846 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.813044 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.813616 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.813874 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.813967 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.814177 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.814263 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.814474 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.814569 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.814771 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.814858 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.815073 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.815160 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.815366 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.815452 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.815660 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.815756 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.815980 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.816078 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.816278 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.816366 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.816572 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.816678 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.816863 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.816951 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.817159 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.817246 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.817474 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.817582 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.817770 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.817895 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.818079 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.818170 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.818378 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.818475 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.818673 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.818761 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.818967 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.819054 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.819260 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.819358 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.819591 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.819680 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.819904 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.820009 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.820209 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.820296 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.820504 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.820598 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.820804 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.820892 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.821101 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.821189 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.821397 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.821484 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.821692 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.821780 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.821992 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.822081 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.822286 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.822374 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.822597 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.822727 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.822873 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.822971 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.823186 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.823275 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.823481 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.823576 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.823794 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.823909 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.824114 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.824214 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.824410 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.824544 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.824706 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.824794 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.824999 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.825087 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.825330 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.825550 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.825639 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.825885 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.826030 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.826180 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.826269 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.826484 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.826572 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.826790 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.826879 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.827096 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.827192 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.827401 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.827489 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.827704 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.827868 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.828032 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.828134 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.828333 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.828430 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.828632 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.828734 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.829491 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.829588 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.829800 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.829895 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.830109 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.830202 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.830412 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.830501 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.830721 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.830808 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.831025 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.831120 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.831331 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.831425 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.831634 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.831857 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.832001 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.832190 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.832399 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.832491 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.832597 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.832772 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.832900 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.833075 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.833208 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.833380 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.833516 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.833684 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.833822 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.833986 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.834126 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.834287 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.834678 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.834842 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.834990 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.835143 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.835295 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.835462 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.835596 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.835775 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.835924 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.836123 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.836265 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.836448 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.836587 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.836758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.836915 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.837065 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.837227 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.837372 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.837533 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.837712 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.837840 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.838026 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.838149 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.838334 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.838635 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.838731 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.838943 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.839031 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.839252 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.839348 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.839566 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.839731 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.839893 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.839985 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.840201 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.840293 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.840508 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.840597 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.840812 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.840898 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.841111 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.841197 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.841409 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.841498 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.841712 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.841800 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.842013 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.842099 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.842309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.842407 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.842621 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.842708 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.842920 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.843008 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.843217 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.843314 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.843525 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.843679 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.843824 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.843942 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.844378 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.844469 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.844691 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.844780 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.845016 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.845115 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.845334 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.845422 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.845652 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.845747 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.845962 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.846063 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.846265 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.846354 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.846579 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.846665 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.846877 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.846978 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.847174 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.847261 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.847476 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.847574 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.847776 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.847884 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.848095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.848191 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.848393 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.848480 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.848693 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.848781 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.848989 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.849077 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.849286 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.849371 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.849589 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.849677 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.849886 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.850110 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.850253 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.850447 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.850537 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.850758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.850847 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.851060 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.851147 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.851364 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.851453 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.851692 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.851789 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.851983 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.852073 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.852281 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.852371 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.852576 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.852664 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.852873 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.852959 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.853166 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.853254 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.853465 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.853560 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.853759 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.853845 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.854057 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.854146 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.854349 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.854434 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.854644 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.854740 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.854941 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.855035 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.855241 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.855338 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.855536 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.855632 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.855868 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.855959 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.856171 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.856305 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.856469 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.856566 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.856765 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.856852 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.857068 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.857157 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.857363 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.857460 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.857658 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.857747 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.857953 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.858057 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.858248 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.858500 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.858589 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.858826 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.858914 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.859122 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.859216 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.859423 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.859511 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.859725 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.859812 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.860082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.860196 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.860388 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.860478 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.860692 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.860777 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.861007 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.861103 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.861309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.861399 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.861602 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.861688 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.861901 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.861997 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.862198 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.862293 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.862494 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.862580 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.862793 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.862889 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.863092 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.863177 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.863390 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.863476 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.863691 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.863781 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.864018 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.864250 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.864345 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.864577 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.864666 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.864890 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.864978 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.865201 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.865289 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.865520 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.865607 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.865819 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.865915 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.866117 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.866204 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.866412 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.866500 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.866716 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.866801 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.867015 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.867100 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.867313 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.867407 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.867611 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.867697 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.867931 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.868171 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.868315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.868400 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.868519 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.868607 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.868819 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.868915 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.869120 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.869208 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.869426 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.869513 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.869725 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.869821 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.870026 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.870114 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.870324 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.870455 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.870622 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.870712 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.870925 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.871013 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.871255 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.871343 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.871566 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.871654 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.871897 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.871989 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.872202 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.872288 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.872508 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.872596 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.872809 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.872896 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.873111 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.873208 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.873412 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.873499 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.873710 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.873804 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.874005 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.874101 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.874301 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.874389 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.874600 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.874688 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.874896 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.874990 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.875199 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.875286 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.875493 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.876190 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.876331 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.876516 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.876634 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.876831 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.876922 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.877132 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.877233 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.877445 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.877533 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.877759 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.877854 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.878058 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.878155 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.878353 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.878453 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.878645 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.878733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.878940 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.879038 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.879235 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.879322 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.879528 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.879616 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.879822 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.879930 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.880141 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.880228 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.880502 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.880615 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.880734 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.880824 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.881029 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.881116 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.881326 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.881413 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.881619 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.881715 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.881918 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.882064 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.882198 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.882354 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.882498 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.882636 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.882782 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.882917 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.883052 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.883196 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.883340 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.883476 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.883613 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.883749 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.883910 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.884070 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.884200 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.884384 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.884496 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.884689 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.884783 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.884993 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.885082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.885316 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.885404 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.885618 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.885714 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.885914 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.886008 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.886211 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.886299 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.886506 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.886650 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.886800 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.886889 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.887096 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.887183 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.887389 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.887485 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.887711 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.887806 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.888042 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.888134 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.888347 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.888487 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.888656 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.888744 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.888952 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.889039 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.889260 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.889354 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.889556 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.889642 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.889867 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.889956 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.890170 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.890269 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.890472 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.890560 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.890769 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.890871 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.891114 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.891253 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.891951 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.892083 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.892265 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.892373 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.892575 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.892671 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.892874 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.892961 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.893175 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.893277 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.893476 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.893572 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.893793 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.893881 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.894110 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.894210 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.894407 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.894494 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.894722 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.894817 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.895031 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.895128 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.895342 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.895430 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.895649 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.895737 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.895974 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.896066 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.896274 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.896369 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.896513 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 11:16:00.896601 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.896873 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.897182 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.897486 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.897789 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.898094 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.898402 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.898718 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.899032 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.899340 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.899660 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.900001 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.900340 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.900648 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.900982 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.901298 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.901605 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.901910 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.902208 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:16:00.902444 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 11:16:01.049495 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO dbcounter [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Registered counter for database nova_api Jun 29 11:16:01.054549 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO dbcounter [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] Registered counter for database nova_api Jun 29 11:16:01.070599 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_db.sqlalchemy.engines [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:16:01.074350 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG oslo_db.sqlalchemy.engines [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:16:01.077191 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writer thread running {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:16:01.081267 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writer thread running {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:16:01.133865 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.context [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbe1565e-37f2-43ef-a64f-991bc8fd407f(cell1) {{(pid=103392) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 11:16:01.136748 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.context [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbe1565e-37f2-43ef-a64f-991bc8fd407f(cell1) {{(pid=103391) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 11:16:01.137807 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:16:01.139380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:16:01.140205 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:16:01.140628 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG oslo_concurrency.lockutils [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:16:01.142188 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:16:01.142302 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG oslo_concurrency.lockutils [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:16:01.142985 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG oslo_concurrency.lockutils [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:16:01.144129 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO dbcounter [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Registered counter for database nova_cell0 Jun 29 11:16:01.144947 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG oslo_concurrency.lockutils [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:16:01.146881 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO dbcounter [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] Registered counter for database nova_cell0 Jun 29 11:16:01.149441 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO dbcounter [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Registered counter for database nova_cell1 Jun 29 11:16:01.152118 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO dbcounter [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] Registered counter for database nova_cell1 Jun 29 11:16:01.156938 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_db.sqlalchemy.engines [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:16:01.158719 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_db.sqlalchemy.engines [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:16:01.160423 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG oslo_db.sqlalchemy.engines [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:16:01.162343 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG oslo_db.sqlalchemy.engines [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:16:01.164611 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writer thread running {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:16:01.166827 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writer thread running {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:16:01.168034 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writer thread running {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:16:01.173812 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writer thread running {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:16:01.311764 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO dbcounter [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Registered counter for database nova_cell0 Jun 29 11:16:01.317051 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO dbcounter [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] Registered counter for database nova_cell0 Jun 29 11:16:01.321119 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_db.sqlalchemy.engines [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:16:01.325101 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG oslo_db.sqlalchemy.engines [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:16:01.325458 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writer thread running {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:16:01.329711 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writer thread running {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:16:01.726207 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: WARNING keystonemiddleware.auth_token [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 11:16:01.733472 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: WARNING keystonemiddleware.auth_token [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 11:16:01.742662 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: WARNING keystonemiddleware.auth_token [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 11:16:01.749930 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: WARNING keystonemiddleware.auth_token [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 11:16:02.072233 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: WARNING keystonemiddleware.auth_token [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 11:16:02.078164 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: WARNING keystonemiddleware.auth_token [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 11:16:02.083960 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618a12ae9c0 pid: 103392 (default app) Jun 29 11:16:02.086256 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:16:02.086606 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: WARNING keystonemiddleware.auth_token [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 11:16:02.087456 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001715 Jun 29 11:16:02.087880 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Wed Jun 29 11:16:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:16:02.092657 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: WARNING keystonemiddleware.auth_token [None req-d001fcb1-bf6e-4eb6-ad6d-6097c085da8b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 11:16:02.098512 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618a12ae9c0 pid: 103391 (default app) Jun 29 11:17:19.690108 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:19.691269 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jun 29 11:17:19.691774 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:17:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:17:19.703862 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_api:SELECT=3 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:19.705012 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_cell1:SELECT=3 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:19.706141 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_cell0:SELECT=3 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:19.707104 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:20.143336 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3e3ed5c0-2bf7-4f9e-b642-9f4b81fe8aa7 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:20.173249 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3e3ed5c0-2bf7-4f9e-b642-9f4b81fe8aa7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.474408 Jun 29 11:17:20.174000 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Wed Jun 29 11:17:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:17:22.269752 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:22.270747 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-f3b49f06-0a12-4916-9d3d-36cb9b1cbc56 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jun 29 11:17:22.271147 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:17:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:17:22.331322 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-df1145fa-b01e-4ff1-b3f1-c3238f8ccc03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:22.349428 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:17:22.349428 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: warnings.warn(msg) Jun 29 11:17:22.439208 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-df1145fa-b01e-4ff1-b3f1-c3238f8ccc03 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.162191 Jun 29 11:17:22.439845 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jun 29 11:17:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 11:17:22.454084 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=3 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:22.455074 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell1:SELECT=3 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:22.456135 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell0:SELECT=3 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:22.456907 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:22.661918 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-9156f45e-5abb-4a2c-ae7e-2d19d4088707 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:22.664283 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:17:22.664283 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jun 29 11:17:22.802020 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-9156f45e-5abb-4a2c-ae7e-2d19d4088707 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.353718 Jun 29 11:17:22.806326 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Wed Jun 29 11:17:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:17:24.864864 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-df1145fa-b01e-4ff1-b3f1-c3238f8ccc03 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:24.865878 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-df1145fa-b01e-4ff1-b3f1-c3238f8ccc03 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 29 11:17:24.866282 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:17:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:17:24.974017 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-7a598a60-19c6-4d3d-bae3-8659ccbd6e32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "ram": 512}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:24.992080 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:17:24.992080 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jun 29 11:17:25.102062 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-7a598a60-19c6-4d3d-bae3-8659ccbd6e32 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.229827 Jun 29 11:17:25.102651 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jun 29 11:17:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 11:17:25.117213 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-ab6493c2-a37d-4979-b10f-1ea368a30cd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:25.119183 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:17:25.119183 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: warnings.warn(msg) Jun 29 11:17:25.251580 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-ab6493c2-a37d-4979-b10f-1ea368a30cd2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140001 Jun 29 11:17:25.252181 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Wed Jun 29 11:17:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:17:27.365296 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-7a598a60-19c6-4d3d-bae3-8659ccbd6e32 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:27.366319 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-7a598a60-19c6-4d3d-bae3-8659ccbd6e32 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 29 11:17:27.366884 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:17:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:17:27.425656 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3087088e-31c7-43e0-8990-7c57c920878d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "ram": 1024, "id": "d2", "disk": 10, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:27.498309 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3087088e-31c7-43e0-8990-7c57c920878d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.125680 Jun 29 11:17:27.499344 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jun 29 11:17:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 11:17:27.511770 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-8608fc75-3791-4190-b403-5e02718ae74b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:27.604997 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-8608fc75-3791-4190-b403-5e02718ae74b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097099 Jun 29 11:17:27.616360 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Wed Jun 29 11:17:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:17:29.677905 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3087088e-31c7-43e0-8990-7c57c920878d admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:29.679045 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3087088e-31c7-43e0-8990-7c57c920878d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Jun 29 11:17:29.684181 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:17:29 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:17:29.744161 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-13aa63e0-398b-4e24-8dab-da6ff7aca9fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:29.822869 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-13aa63e0-398b-4e24-8dab-da6ff7aca9fd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137195 Jun 29 11:17:29.823418 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jun 29 11:17:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:17:29.835430 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-22001973-eb91-4f48-b822-2182057e7f3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:29.895241 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-22001973-eb91-4f48-b822-2182057e7f3e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063178 Jun 29 11:17:29.895650 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Wed Jun 29 11:17:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:17:31.972223 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-13aa63e0-398b-4e24-8dab-da6ff7aca9fd admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:31.974181 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-13aa63e0-398b-4e24-8dab-da6ff7aca9fd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002499 Jun 29 11:17:31.974571 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:17:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:17:32.039339 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-b89c461b-85bd-420a-9b4d-5e487144529b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:32.120394 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-b89c461b-85bd-420a-9b4d-5e487144529b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139704 Jun 29 11:17:32.120951 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jun 29 11:17:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:17:32.133557 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a2bb56c9-b7e8-41cc-9380-5e1891acb9e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:32.215726 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-a2bb56c9-b7e8-41cc-9380-5e1891acb9e1 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085933 Jun 29 11:17:32.216388 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Wed Jun 29 11:17:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:17:34.275776 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-b89c461b-85bd-420a-9b4d-5e487144529b admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:34.276821 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-b89c461b-85bd-420a-9b4d-5e487144529b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 29 11:17:34.277479 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:17:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:17:34.340169 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a8317728-5b4e-4426-8afc-b9c0ecc16b95 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:34.369246 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-a8317728-5b4e-4426-8afc-b9c0ecc16b95 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085802 Jun 29 11:17:34.377754 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Wed Jun 29 11:17:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:17:36.531581 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-b89c461b-85bd-420a-9b4d-5e487144529b admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:36.532650 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-b89c461b-85bd-420a-9b4d-5e487144529b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jun 29 11:17:36.533055 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:17:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:17:36.594391 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-c62b04cd-65b4-4201-b150-255f24c82898 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "1", "ram": 512, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:36.668516 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-c62b04cd-65b4-4201-b150-255f24c82898 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.129257 Jun 29 11:17:36.669074 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jun 29 11:17:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 11:17:36.683076 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-f543fabc-b061-4979-b6eb-ae6c4c82f63d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:36.772697 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-f543fabc-b061-4979-b6eb-ae6c4c82f63d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092804 Jun 29 11:17:36.773907 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Wed Jun 29 11:17:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:17:38.845925 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-c62b04cd-65b4-4201-b150-255f24c82898 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:38.846930 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-c62b04cd-65b4-4201-b150-255f24c82898 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 29 11:17:38.847319 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:17:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:17:38.905244 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-218cca60-3788-4b66-b274-3d7cdb3be1ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:38.989403 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-218cca60-3788-4b66-b274-3d7cdb3be1ca admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.136163 Jun 29 11:17:38.989990 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jun 29 11:17:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 11:17:39.002352 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-20ab54c6-fd7c-4434-bb80-7ac7bbcaca44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:39.084840 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-20ab54c6-fd7c-4434-bb80-7ac7bbcaca44 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086600 Jun 29 11:17:39.085350 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Wed Jun 29 11:17:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:17:41.235172 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-218cca60-3788-4b66-b274-3d7cdb3be1ca admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:41.236213 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-218cca60-3788-4b66-b274-3d7cdb3be1ca admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 29 11:17:41.236607 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:17:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:17:41.294877 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-814ecafa-57e1-40fc-b82f-11f5a657d928 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:41.386748 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-814ecafa-57e1-40fc-b82f-11f5a657d928 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.144280 Jun 29 11:17:41.387306 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jun 29 11:17:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 11:17:41.399730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-79050ef4-1d7c-4c20-bcf2-f8b150c93acd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:41.481108 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-79050ef4-1d7c-4c20-bcf2-f8b150c93acd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085006 Jun 29 11:17:41.481697 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Wed Jun 29 11:17:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:17:43.582903 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-814ecafa-57e1-40fc-b82f-11f5a657d928 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:43.583967 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-814ecafa-57e1-40fc-b82f-11f5a657d928 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 29 11:17:43.584369 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:17:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:17:43.643609 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-5222c833-b7d1-4861-8028-43a1a60c89ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "disk": 80, "swap": 0}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:43.726737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-5222c833-b7d1-4861-8028-43a1a60c89ff admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.136110 Jun 29 11:17:43.727292 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jun 29 11:17:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 11:17:43.739748 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-f4cc840b-e48a-49fb-b954-e934911a443c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:43.832651 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-f4cc840b-e48a-49fb-b954-e934911a443c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096463 Jun 29 11:17:43.833139 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Wed Jun 29 11:17:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:17:45.897862 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-5222c833-b7d1-4861-8028-43a1a60c89ff admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:17:45.899719 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-5222c833-b7d1-4861-8028-43a1a60c89ff admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 29 11:17:45.899719 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:17:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:17:45.979350 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-e2e4e4db-f82e-43ab-983f-9b471370421f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:46.512050 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-e2e4e4db-f82e-43ab-983f-9b471370421f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.601834 Jun 29 11:17:46.512917 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jun 29 11:17:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:17:46.524711 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-50f55c41-e8a3-4088-9a1f-c3cf83b45d4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:17:46.679359 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-50f55c41-e8a3-4088-9a1f-c3cf83b45d4a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.158198 Jun 29 11:17:46.680144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Wed Jun 29 11:17:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:18:11.716704 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-e2e4e4db-f82e-43ab-983f-9b471370421f admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:11.717702 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-e2e4e4db-f82e-43ab-983f-9b471370421f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 29 11:18:11.718178 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:18:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:18:11.728890 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:11.776988 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-da9d0b0c-4069-4491-8928-f66a70d4d2fd admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:11.793978 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-da9d0b0c-4069-4491-8928-f66a70d4d2fd admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069698 Jun 29 11:18:11.794510 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Wed Jun 29 11:18:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:18:12.713706 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-e2e4e4db-f82e-43ab-983f-9b471370421f admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:12.714695 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-e2e4e4db-f82e-43ab-983f-9b471370421f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Jun 29 11:18:12.715087 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jun 29 11:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:18:12.909071 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-2a2ccebf-ae44-44f6-b142-9bf5bd594dcc admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:12.910034 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.wsgi [None req-2a2ccebf-ae44-44f6-b142-9bf5bd594dcc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-2a2ccebf-ae44-44f6-b142-9bf5bd594dcc admin admin] Request method failure captured: Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Accept: application/json Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Accept-Encoding: gzip, deflate Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Connection: keep-alive Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Content-Length: 0 Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Host: 10.222.0.44 Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Openstack-Api-Version: compute 2.90 Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Openstack-System-Scope: None Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: User-Agent: python-novaclient Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Auth-Token: gAAAAABivDT0kew_9c6OiWxvh6caLAbsZAozMALS11oMnSJHlV4u0EOCM2ml95H6LnfZxntM0UAS6xjZyYW9fg6pUK9Y-B4pnvJwa-63w3MT6MefMDFZUDKRPdzTwRx8XXywX4KsxFA-iCyfmzH-QRHpZUS3DPfW-0-k1OGyCZznARUngbmqhtQ Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Domain-Id: None Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Domain-Name: None Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Identity-Status: Confirmed Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Is-Admin-Project: True Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Project-Domain-Id: default Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Project-Domain-Name: Default Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Project-Id: 37897f6664b94d219c11b87aa269041a Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Project-Name: admin Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Role: member,admin,reader Jun 29 11:18:12.913315 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Roles: member,admin,reader Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/37897f6664b94d219c11b87aa269041a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_37897f6664b94d219c11b87aa269041a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/37897f6664b94d219c11b87aa269041a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/37897f6664b94d219c11b87aa269041a"}]}] Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Tenant: admin Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Tenant-Id: 37897f6664b94d219c11b87aa269041a Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Tenant-Name: admin Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User: admin Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User-Domain-Id: default Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User-Domain-Name: Default Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User-Id: cdb4139035bd4d46a35dca750b630776 Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User-Name: admin Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: method: > Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: exception: Flavor 42 could not be found. Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: action_args: {'id': '42'} Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:18:12.914991 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:18:12.915960 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:12.917082 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-2a2ccebf-ae44-44f6-b142-9bf5bd594dcc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:18:12.918129 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-2a2ccebf-ae44-44f6-b142-9bf5bd594dcc admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062375 Jun 29 11:18:12.918129 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Wed Jun 29 11:18:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:12.925266 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-d826930e-d56b-432e-b69e-e41470b03052 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:12.928173 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:12.946455 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-d826930e-d56b-432e-b69e-e41470b03052 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025328 Jun 29 11:18:12.946990 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Jun 29 11:18:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:18:12.957211 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-9b1a3bb6-a2bb-440a-a9cc-9dfccc9e8dd5 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:12.979141 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-9b1a3bb6-a2bb-440a-a9cc-9dfccc9e8dd5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026117 Jun 29 11:18:12.979668 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Jun 29 11:18:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:18:12.989400 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a9d2caf1-3bcf-471c-bc57-d12dc07bd33d admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:12.995292 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.wsgi [None req-a9d2caf1-3bcf-471c-bc57-d12dc07bd33d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a9d2caf1-3bcf-471c-bc57-d12dc07bd33d admin admin] Request method failure captured: Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Accept: application/json Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Accept-Encoding: gzip, deflate Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Connection: keep-alive Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Content-Length: 0 Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Host: 10.222.0.44 Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Openstack-Api-Version: compute 2.90 Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Openstack-System-Scope: None Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: User-Agent: python-novaclient Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Auth-Token: gAAAAABivDT0kew_9c6OiWxvh6caLAbsZAozMALS11oMnSJHlV4u0EOCM2ml95H6LnfZxntM0UAS6xjZyYW9fg6pUK9Y-B4pnvJwa-63w3MT6MefMDFZUDKRPdzTwRx8XXywX4KsxFA-iCyfmzH-QRHpZUS3DPfW-0-k1OGyCZznARUngbmqhtQ Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Domain-Id: None Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Domain-Name: None Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Identity-Status: Confirmed Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Is-Admin-Project: True Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Project-Domain-Id: default Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Project-Domain-Name: Default Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Project-Id: 37897f6664b94d219c11b87aa269041a Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Project-Name: admin Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Role: member,admin,reader Jun 29 11:18:12.998534 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Roles: member,admin,reader Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/37897f6664b94d219c11b87aa269041a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_37897f6664b94d219c11b87aa269041a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/37897f6664b94d219c11b87aa269041a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/37897f6664b94d219c11b87aa269041a"}]}] Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Tenant: admin Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Tenant-Id: 37897f6664b94d219c11b87aa269041a Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Tenant-Name: admin Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User: admin Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User-Domain-Id: default Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User-Domain-Name: Default Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User-Id: cdb4139035bd4d46a35dca750b630776 Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User-Name: admin Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: method: > Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: exception: Flavor 42 could not be found. Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: action_args: {'id': '42'} Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:18:13.000088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:18:13.001082 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:13.002272 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a9d2caf1-3bcf-471c-bc57-d12dc07bd33d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:18:13.003267 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-a9d2caf1-3bcf-471c-bc57-d12dc07bd33d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013982 Jun 29 11:18:13.003267 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Wed Jun 29 11:18:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:13.821214 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-9b1a3bb6-a2bb-440a-a9cc-9dfccc9e8dd5 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:13.822210 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-9b1a3bb6-a2bb-440a-a9cc-9dfccc9e8dd5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 29 11:18:13.822600 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jun 29 11:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:18:14.021001 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-b1577f94-f6dd-4037-8de8-358b9194cbf5 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:14.026205 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.wsgi [None req-b1577f94-f6dd-4037-8de8-358b9194cbf5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-b1577f94-f6dd-4037-8de8-358b9194cbf5 admin admin] Request method failure captured: Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Accept: application/json Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Accept-Encoding: gzip, deflate Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Connection: keep-alive Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Content-Length: 0 Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Host: 10.222.0.44 Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Openstack-Api-Version: compute 2.90 Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Openstack-System-Scope: None Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: User-Agent: python-novaclient Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Auth-Token: gAAAAABivDT1aH-Kbc8bKMjMQC0pom-LpxBB9SIoQpBp00Gx8NnlG_zV2jTlnCMVp20Xf9bgCS3rAF0SPA5uyvdwW912Qh-1mxtfEFYojpZNw8-HtqLAIO7pZS9jY95wA4dS2HSVXbhsInDkOMy5YJxrUQ1RvZcq8czQKr3-S5AvUVY5BXs9R3c Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Domain-Id: None Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Domain-Name: None Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Identity-Status: Confirmed Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Is-Admin-Project: True Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Project-Domain-Id: default Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Project-Domain-Name: Default Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Project-Id: 37897f6664b94d219c11b87aa269041a Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Project-Name: admin Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Role: member,admin,reader Jun 29 11:18:14.027753 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Roles: member,admin,reader Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/37897f6664b94d219c11b87aa269041a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_37897f6664b94d219c11b87aa269041a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/37897f6664b94d219c11b87aa269041a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/37897f6664b94d219c11b87aa269041a"}]}] Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Tenant: admin Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Tenant-Id: 37897f6664b94d219c11b87aa269041a Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Tenant-Name: admin Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User: admin Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User-Domain-Id: default Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User-Domain-Name: Default Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User-Id: cdb4139035bd4d46a35dca750b630776 Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User-Name: admin Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: method: > Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: exception: Flavor 84 could not be found. Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: action_args: {'id': '84'} Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:18:14.029309 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:18:14.030368 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:14.031811 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-b1577f94-f6dd-4037-8de8-358b9194cbf5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:18:14.033310 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-b1577f94-f6dd-4037-8de8-358b9194cbf5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068826 Jun 29 11:18:14.033310 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Wed Jun 29 11:18:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:14.038673 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-5e7bef6c-75e7-4760-86b7-ba845e27e516 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:14.054154 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-5e7bef6c-75e7-4760-86b7-ba845e27e516 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019053 Jun 29 11:18:14.054676 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Jun 29 11:18:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:18:14.064816 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a3f8dfa7-a121-4f1d-8144-26c9ac52a665 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:14.078659 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-a3f8dfa7-a121-4f1d-8144-26c9ac52a665 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018260 Jun 29 11:18:14.079181 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Jun 29 11:18:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:18:14.088392 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-616268cb-7fcb-4add-940e-097c818c4013 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:14.093652 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.wsgi [None req-616268cb-7fcb-4add-940e-097c818c4013 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-616268cb-7fcb-4add-940e-097c818c4013 admin admin] Request method failure captured: Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Accept: application/json Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Accept-Encoding: gzip, deflate Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Connection: keep-alive Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Content-Length: 0 Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Host: 10.222.0.44 Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Openstack-Api-Version: compute 2.90 Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Openstack-System-Scope: None Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: User-Agent: python-novaclient Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Auth-Token: gAAAAABivDT1aH-Kbc8bKMjMQC0pom-LpxBB9SIoQpBp00Gx8NnlG_zV2jTlnCMVp20Xf9bgCS3rAF0SPA5uyvdwW912Qh-1mxtfEFYojpZNw8-HtqLAIO7pZS9jY95wA4dS2HSVXbhsInDkOMy5YJxrUQ1RvZcq8czQKr3-S5AvUVY5BXs9R3c Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Domain-Id: None Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Domain-Name: None Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Identity-Status: Confirmed Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Is-Admin-Project: True Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Project-Domain-Id: default Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Project-Domain-Name: Default Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Project-Id: 37897f6664b94d219c11b87aa269041a Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Project-Name: admin Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Role: member,admin,reader Jun 29 11:18:14.095145 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Roles: member,admin,reader Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/37897f6664b94d219c11b87aa269041a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_37897f6664b94d219c11b87aa269041a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/37897f6664b94d219c11b87aa269041a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/37897f6664b94d219c11b87aa269041a"}]}] Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Tenant: admin Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Tenant-Id: 37897f6664b94d219c11b87aa269041a Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Tenant-Name: admin Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User: admin Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User-Domain-Id: default Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User-Domain-Name: Default Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User-Id: cdb4139035bd4d46a35dca750b630776 Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User-Name: admin Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: method: > Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: exception: Flavor 84 could not be found. Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: action_args: {'id': '84'} Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:18:14.096758 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:18:14.097737 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:14.099144 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-616268cb-7fcb-4add-940e-097c818c4013 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:18:14.100462 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-616268cb-7fcb-4add-940e-097c818c4013 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011848 Jun 29 11:18:14.100462 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Wed Jun 29 11:18:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 29 11:18:14.918692 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a3f8dfa7-a121-4f1d-8144-26c9ac52a665 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:14.919686 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-a3f8dfa7-a121-4f1d-8144-26c9ac52a665 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 29 11:18:14.920126 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jun 29 11:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:18:15.127634 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-94996071-470f-4f9a-b0ee-566042f6197f admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:15.133659 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.wsgi [None req-94996071-470f-4f9a-b0ee-566042f6197f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-94996071-470f-4f9a-b0ee-566042f6197f admin admin] Request method failure captured: Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Accept: application/json Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Accept-Encoding: gzip, deflate Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Connection: keep-alive Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Content-Length: 0 Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Host: 10.222.0.44 Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Openstack-Api-Version: compute 2.90 Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Openstack-System-Scope: None Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: User-Agent: python-novaclient Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Auth-Token: gAAAAABivDT2G3h34xuhqyIBELFeepwH8rZIBNOgnXci2VDa2CNoiZw77NzClhSeRiC_sDnSX47708NlVWHvjo8rUIaX8GASnkF9MAxwQyRnuSGO4O2IXHUoepST2VVWmMPB4KbbsCvI5-uSwvJ3B8izCNG0ZFLHMMoQZhmvqk_4cnrjVItB_XM Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Domain-Id: None Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Domain-Name: None Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Identity-Status: Confirmed Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Is-Admin-Project: True Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Project-Domain-Id: default Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Project-Domain-Name: Default Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Project-Id: 37897f6664b94d219c11b87aa269041a Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Project-Name: admin Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Role: member,admin,reader Jun 29 11:18:15.135164 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Roles: member,admin,reader Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/37897f6664b94d219c11b87aa269041a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_37897f6664b94d219c11b87aa269041a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/37897f6664b94d219c11b87aa269041a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/37897f6664b94d219c11b87aa269041a"}]}] Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Tenant: admin Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Tenant-Id: 37897f6664b94d219c11b87aa269041a Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-Tenant-Name: admin Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User: admin Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User-Domain-Id: default Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User-Domain-Name: Default Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User-Id: cdb4139035bd4d46a35dca750b630776 Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: X-User-Name: admin Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: method: > Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: exception: Flavor 451 could not be found. Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: action_args: {'id': '451'} Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:18:15.136733 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:18:15.137730 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jun 29 11:18:15.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-94996071-470f-4f9a-b0ee-566042f6197f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:18:15.140980 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-94996071-470f-4f9a-b0ee-566042f6197f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.064953 Jun 29 11:18:15.140980 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Jun 29 11:18:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:15.148379 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-692c741e-3a4c-4057-82ed-8d5f51e93f13 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:15.163488 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-692c741e-3a4c-4057-82ed-8d5f51e93f13 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018771 Jun 29 11:18:15.164065 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Jun 29 11:18:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:18:15.174307 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:15.188651 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017821 Jun 29 11:18:15.189196 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Jun 29 11:18:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:18:15.200584 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-4e79f85d-00fd-4957-b9dc-58ec9e53e137 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:15.206588 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.wsgi [None req-4e79f85d-00fd-4957-b9dc-58ec9e53e137 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-4e79f85d-00fd-4957-b9dc-58ec9e53e137 admin admin] Request method failure captured: Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Accept: application/json Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Accept-Encoding: gzip, deflate Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Connection: keep-alive Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Content-Length: 0 Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Host: 10.222.0.44 Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Openstack-Api-Version: compute 2.90 Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Openstack-System-Scope: None Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: User-Agent: python-novaclient Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Auth-Token: gAAAAABivDT2G3h34xuhqyIBELFeepwH8rZIBNOgnXci2VDa2CNoiZw77NzClhSeRiC_sDnSX47708NlVWHvjo8rUIaX8GASnkF9MAxwQyRnuSGO4O2IXHUoepST2VVWmMPB4KbbsCvI5-uSwvJ3B8izCNG0ZFLHMMoQZhmvqk_4cnrjVItB_XM Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Domain-Id: None Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Domain-Name: None Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Identity-Status: Confirmed Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Is-Admin-Project: True Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Project-Domain-Id: default Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Project-Domain-Name: Default Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Project-Id: 37897f6664b94d219c11b87aa269041a Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Project-Name: admin Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Role: member,admin,reader Jun 29 11:18:15.208145 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Roles: member,admin,reader Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/37897f6664b94d219c11b87aa269041a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_37897f6664b94d219c11b87aa269041a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/37897f6664b94d219c11b87aa269041a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/37897f6664b94d219c11b87aa269041a"}]}] Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Tenant: admin Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Tenant-Id: 37897f6664b94d219c11b87aa269041a Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-Tenant-Name: admin Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User: admin Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User-Domain-Id: default Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User-Domain-Name: Default Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User-Id: cdb4139035bd4d46a35dca750b630776 Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: X-User-Name: admin Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: method: > Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: exception: Flavor 451 could not be found. Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: action_args: {'id': '451'} Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:18:15.210380 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:18:15.211625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jun 29 11:18:15.213291 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-4e79f85d-00fd-4957-b9dc-58ec9e53e137 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:18:15.214536 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-4e79f85d-00fd-4957-b9dc-58ec9e53e137 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012579 Jun 29 11:18:15.214536 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Jun 29 11:18:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 29 11:18:16.045382 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:16.046389 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 29 11:18:16.046786 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jun 29 11:18:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:18:16.236321 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-f49494d6-69c7-4e6b-a26a-993a68236e0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:18:16.333024 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-f49494d6-69c7-4e6b-a26a-993a68236e0c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.148351 Jun 29 11:18:16.333556 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Wed Jun 29 11:18:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:18:17.152271 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:17.153277 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 29 11:18:17.153668 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jun 29 11:18:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:18:17.343692 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-82296657-a1ed-4025-9111-4df4def3fb3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:18:17.574302 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-82296657-a1ed-4025-9111-4df4def3fb3d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.284196 Jun 29 11:18:17.574777 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Wed Jun 29 11:18:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:18:18.385565 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:18.386564 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 29 11:18:18.386962 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jun 29 11:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:18:18.573842 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a3325472-a5ac-4935-bd21-4860dc2bd068 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:18:18.659086 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-a3325472-a5ac-4935-bd21-4860dc2bd068 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.135812 Jun 29 11:18:18.659622 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Wed Jun 29 11:18:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:18:19.483022 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:19.484641 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Jun 29 11:18:19.485047 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jun 29 11:18:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:18:19.675192 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-db6349a0-3b41-47e9-b13b-fbd52313c71e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:18:19.766400 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-db6349a0-3b41-47e9-b13b-fbd52313c71e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.143870 Jun 29 11:18:19.766869 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Wed Jun 29 11:18:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:18:20.586099 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:20.587098 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jun 29 11:18:20.587492 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jun 29 11:18:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:18:20.774700 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-ec7c135d-60f3-4ac1-a89e-5a1fc120e5aa admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:18:20.794032 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-ec7c135d-60f3-4ac1-a89e-5a1fc120e5aa admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069075 Jun 29 11:18:20.794561 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Wed Jun 29 11:18:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:19:07.453735 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:19:07.454735 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-1be610b3-c95b-4ef2-86b3-7a07885ee2d5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 29 11:19:07.455160 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jun 29 11:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:19:07.465594 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:07.513510 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-23d43988-35b9-48a6-b7e3-681e09f7c368 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:19:07.533088 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-23d43988-35b9-48a6-b7e3-681e09f7c368 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072106 Jun 29 11:19:07.533623 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Wed Jun 29 11:19:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:19:07.556606 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-238389f0-0256-4157-94b0-1216271e3c46 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:19:07.560019 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_api:SELECT=14 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:07.564931 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-238389f0-0256-4157-94b0-1216271e3c46 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011918 Jun 29 11:19:07.565442 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Wed Jun 29 11:19:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:19:07.577021 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-066866fc-746f-48ee-847e-a736c403b5da admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:19:07.584685 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-066866fc-746f-48ee-847e-a736c403b5da admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011189 Jun 29 11:19:07.585206 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Wed Jun 29 11:19:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:19:07.597069 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-a242fc74-aa0d-4f8a-a724-a67f8f83e9a7 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:19:07.604893 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-a242fc74-aa0d-4f8a-a724-a67f8f83e9a7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011237 Jun 29 11:19:07.605423 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Wed Jun 29 11:19:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:19:07.616823 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-946020b3-09bd-4f60-861d-bc1c1a805c6e admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:19:07.624194 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-946020b3-09bd-4f60-861d-bc1c1a805c6e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010767 Jun 29 11:19:07.624696 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Wed Jun 29 11:19:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:22:34.496224 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-a242fc74-aa0d-4f8a-a724-a67f8f83e9a7 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:22:34.497234 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-a242fc74-aa0d-4f8a-a724-a67f8f83e9a7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 29 11:22:34.497631 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jun 29 11:22:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:22:34.647722 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=6 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:22:34.764172 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-2896d7c2-c3d9-4de2-8849-97c7a99e7f9d admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:22:34.765337 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:22:34.765337 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jun 29 11:22:34.766527 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-2896d7c2-c3d9-4de2-8849-97c7a99e7f9d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:22:34.766962 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-2896d7c2-c3d9-4de2-8849-97c7a99e7f9d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:22:34.767739 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-2896d7c2-c3d9-4de2-8849-97c7a99e7f9d admin admin] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:22:34.768186 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-2896d7c2-c3d9-4de2-8849-97c7a99e7f9d admin admin] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:22:34.802195 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-2896d7c2-c3d9-4de2-8849-97c7a99e7f9d admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.158912 Jun 29 11:22:34.802752 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Jun 29 11:22:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:22:35.622946 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-a242fc74-aa0d-4f8a-a724-a67f8f83e9a7 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:22:35.624005 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-a242fc74-aa0d-4f8a-a724-a67f8f83e9a7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jun 29 11:22:35.624422 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jun 29 11:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:22:35.812455 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-1c6407df-2b64-4dba-83d5-66a330880f76 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:22:35.813625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:22:35.813625 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jun 29 11:22:35.814831 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-1c6407df-2b64-4dba-83d5-66a330880f76 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:22:35.815267 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-1c6407df-2b64-4dba-83d5-66a330880f76 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:22:35.816076 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-1c6407df-2b64-4dba-83d5-66a330880f76 admin admin] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:22:35.816501 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-1c6407df-2b64-4dba-83d5-66a330880f76 admin admin] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:22:35.836666 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-1c6407df-2b64-4dba-83d5-66a330880f76 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074105 Jun 29 11:22:35.837146 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Jun 29 11:22:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:22:47.090062 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-a242fc74-aa0d-4f8a-a724-a67f8f83e9a7 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:22:47.091063 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-a242fc74-aa0d-4f8a-a724-a67f8f83e9a7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 29 11:22:47.091455 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jun 29 11:22:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:22:47.236449 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell0:SELECT=4 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:22:47.237183 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell1:SELECT=4 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:22:47.237997 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=8 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:22:47.285909 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-d70cafe9-4b28-48a3-b589-70fb69d9f564 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:22:47.287308 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:22:47.287308 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jun 29 11:22:47.288485 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-d70cafe9-4b28-48a3-b589-70fb69d9f564 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:22:47.288925 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-d70cafe9-4b28-48a3-b589-70fb69d9f564 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:22:47.289711 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-d70cafe9-4b28-48a3-b589-70fb69d9f564 admin admin] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:22:47.290136 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-d70cafe9-4b28-48a3-b589-70fb69d9f564 admin admin] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:22:47.315084 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-d70cafe9-4b28-48a3-b589-70fb69d9f564 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083030 Jun 29 11:22:47.315634 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Jun 29 11:22:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:22:48.126944 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-a242fc74-aa0d-4f8a-a724-a67f8f83e9a7 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:22:48.127967 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-a242fc74-aa0d-4f8a-a724-a67f8f83e9a7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 29 11:22:48.128360 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jun 29 11:22:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:22:48.316130 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-c71d6912-0f2a-4904-874b-d230e0665e4f admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:22:48.317333 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:22:48.317333 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jun 29 11:22:48.319150 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-c71d6912-0f2a-4904-874b-d230e0665e4f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:22:48.319583 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-c71d6912-0f2a-4904-874b-d230e0665e4f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:22:48.320395 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-c71d6912-0f2a-4904-874b-d230e0665e4f admin admin] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:22:48.320814 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-c71d6912-0f2a-4904-874b-d230e0665e4f admin admin] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:22:48.341694 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-c71d6912-0f2a-4904-874b-d230e0665e4f admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.075690 Jun 29 11:22:48.342479 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Jun 29 11:22:48 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:23:44.694267 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: Wed Jun 29 11:23:44 2022 - graceful shutdown triggered... Jun 29 11:23:44.694505 dv-cinder-847335-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 29 11:23:44.695724 dv-cinder-847335-2-iscsi devstack@n-api.service[103392]: Gracefully killing worker 2 (pid: 103392)... Jun 29 11:23:44.697055 dv-cinder-847335-2-iscsi devstack@n-api.service[103391]: Gracefully killing worker 1 (pid: 103391)... Jun 29 11:23:45.694832 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: worker 1 buried after 1 seconds Jun 29 11:23:45.695426 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: worker 2 buried after 1 seconds Jun 29 11:23:45.695426 dv-cinder-847335-2-iscsi devstack@n-api.service[103390]: goodbye to uWSGI. Jun 29 11:23:45.696384 dv-cinder-847335-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 29 11:23:45.696932 dv-cinder-847335-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 29 11:23:45.699675 dv-cinder-847335-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 29 11:23:45.710499 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 29 11:23:45.712502 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 11:23:45 2022] *** Jun 29 11:23:45.712502 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 11:23:45.712502 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 11:23:45.712502 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: nodename: dv-cinder-847335-2-iscsi Jun 29 11:23:45.712502 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: machine: x86_64 Jun 29 11:23:45.712502 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: clock source: unix Jun 29 11:23:45.712502 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: pcre jit disabled Jun 29 11:23:45.712502 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: detected number of CPU cores: 4 Jun 29 11:23:45.712502 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: current working directory: / Jun 29 11:23:45.712502 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: detected binary path: /usr/bin/uwsgi-core Jun 29 11:23:45.713296 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: your processes number limit is 47680 Jun 29 11:23:45.713296 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: your memory page size is 4096 bytes Jun 29 11:23:45.713296 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: detected max file descriptor number: 2048 Jun 29 11:23:45.713296 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: lock engine: pthread robust mutexes Jun 29 11:23:45.713296 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: thunder lock: enabled Jun 29 11:23:45.713296 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 29 11:23:45.713296 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 11:23:45.758374 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: Python main interpreter initialized at 0x55d21ecae9c0 Jun 29 11:23:45.758374 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: python threads support enabled Jun 29 11:23:45.758374 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: your server socket listen backlog is limited to 100 connections Jun 29 11:23:45.758374 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: your mercy for graceful operations on workers is 90 seconds Jun 29 11:23:45.758843 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 11:23:45.758843 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: *** Operational MODE: preforking *** Jun 29 11:23:45.759089 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: *** uWSGI is running in multiple interpreter mode *** Jun 29 11:23:45.759089 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: spawned uWSGI master process (pid: 117900) Jun 29 11:23:45.759307 dv-cinder-847335-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 29 11:23:45.759855 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: spawned uWSGI worker 1 (pid: 117920, cores: 1) Jun 29 11:23:45.760378 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: spawned uWSGI worker 2 (pid: 117921, cores: 1) Jun 29 11:23:45.760637 dv-cinder-847335-2-iscsi devstack@n-api.service[117900]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 11:23:46.438920 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 11:23:46.446168 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 11:23:47.672951 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 11:23:47.672951 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: from cryptography.utils import int_from_bytes Jun 29 11:23:47.673541 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 11:23:47.673541 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: from cryptography.utils import int_from_bytes Jun 29 11:23:47.683603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 11:23:47.683603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: from cryptography.utils import int_from_bytes Jun 29 11:23:47.684151 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 11:23:47.684151 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: from cryptography.utils import int_from_bytes Jun 29 11:23:50.081482 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 11:23:50.082021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 11:23:50.082306 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 11:23:50.082559 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 11:23:50.082815 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 11:23:50.083207 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.083535 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.083874 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.084198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.084531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.084842 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.085171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.085507 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.085859 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.086122 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.086438 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.086763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847335-2-iscsi {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.087099 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.087395 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.087709 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.088052 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.088356 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.088680 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.088989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.089489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.090875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.090875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.090875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.091231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.091491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.091801 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.092147 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.092460 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.092786 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.093361 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.093763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847335-2-iscsi {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.094077 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.094387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.094702 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.095126 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.095436 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.095742 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.096156 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.096475 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.096801 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.096919 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 11:23:50.097341 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 11:23:50.097441 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.097441 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.097730 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 11:23:50.097924 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.098161 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 11:23:50.098349 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.099072 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 11:23:50.099255 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.099437 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.099593 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.099744 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.099946 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.100103 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.100251 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.100251 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.100845 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.101000 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.101151 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.101906 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.102057 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.102200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.102341 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.102508 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.102655 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.102825 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.102968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.103120 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.103273 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.103461 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.103651 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.103802 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.104023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847335-2-iscsi {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.104184 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.104335 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.104503 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.104676 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.104820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.104969 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.105118 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.105271 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.105424 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.105581 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.105725 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.105866 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.106013 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.106192 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.106352 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.106352 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.107510 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.107682 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.107867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.108018 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.108175 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.108324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.108484 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.108629 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.108770 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.108922 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.109073 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.109227 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.109377 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.109377 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.109665 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.109819 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.109963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.110116 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.110266 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.110536 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.110685 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.110685 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.110971 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847335-2-iscsi {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.111120 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.111272 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.111422 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.111578 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.111728 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.111906 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.112065 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.112218 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.112600 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.112755 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.112905 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.113049 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.113201 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.113354 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.113502 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.113832 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.113988 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.114132 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.114281 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.114467 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.114572 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.114671 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.114756 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.114839 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.114924 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.115009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.115102 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.115194 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.115278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.115360 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.115451 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.115534 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.115629 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.115715 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.115797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.115945 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.116043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.116137 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.116223 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.116313 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.116403 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.116486 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.116579 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.116672 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.116763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.116868 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.118139 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.118228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.118320 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.118418 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.118532 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.118628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.118715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.118807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.118900 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.118992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.119076 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.119158 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.119247 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.119337 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.119434 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.119525 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.119616 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.119711 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.119805 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.119915 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.120000 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.120082 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.120164 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.120255 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.120255 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.120408 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.120489 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.120571 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.120660 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.120754 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.120843 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.120935 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.121018 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.121132 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.121322 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.121435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.121718 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.121811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.121970 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.122062 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.122276 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.122379 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.122612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.122704 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.122930 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.123037 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.123234 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.123336 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.123541 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.123641 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.123890 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.123999 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.124172 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.124273 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.124476 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.124566 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.124777 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.124881 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.125082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.125180 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.125383 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.125473 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.125701 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.125804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.125953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.126044 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.126254 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.126345 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.126557 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.126658 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.126874 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.126964 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.127180 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.127283 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.127489 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.127693 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.128119 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.128220 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.128312 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.128403 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.128500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.128591 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.128714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.128835 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.129022 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.129125 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.129334 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.129427 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.129640 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.129738 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.129943 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.130035 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.130249 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.130348 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.130551 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.130642 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.130856 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.130956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.131171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.131262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.131489 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.131579 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.131794 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.131925 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.132123 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.132215 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.132432 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.132557 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.132776 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.132875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.133096 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.133194 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.133401 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.133501 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.133704 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.133795 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.134064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.134191 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.134386 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.134507 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.134699 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.134818 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.135044 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.135143 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.135388 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.135480 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.135709 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.135800 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.136060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.136170 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.136362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.136452 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.136671 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.136769 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.136987 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.137131 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.137297 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.137461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.137598 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.137686 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.138014 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.138141 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.138237 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.138311 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.138521 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.138614 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.138791 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.138893 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.139100 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.139198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.139406 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.139496 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.139707 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.139794 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.140053 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.140137 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.140374 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.140467 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.140683 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.140770 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.140990 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.141080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.141294 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.141375 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.142716 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.142832 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:23:50.142923 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.143011 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.143102 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.143186 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.143269 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.143359 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.143452 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.143536 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.143625 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.143709 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.143798 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.143923 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.144999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.145096 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.145171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.145249 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.145329 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.145466 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.145564 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.145663 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.145748 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.145851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.146016 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.146113 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.146205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.146296 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.146387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.146479 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.146578 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.146662 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.146744 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.146826 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.146915 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.146999 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.147142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.147247 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.147455 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.147546 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.147762 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.147877 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.148151 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.148323 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.148495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.148651 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.148800 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.148955 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.149098 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.149248 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.149389 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.149529 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.149669 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.149822 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.150066 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.150215 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.150356 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.150507 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.150654 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.150807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.150955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.151105 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.151244 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.151382 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.151528 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.151699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.151959 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.152200 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.152357 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.152514 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.152664 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.152811 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.152953 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.153099 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.153246 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.153385 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.153589 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.153731 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.153871 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.154019 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.154166 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.154308 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.154470 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.154617 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.154760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.154906 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.155055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.155194 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.155342 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.155489 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.155636 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.155783 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.155947 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.156097 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.156198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.156283 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.156366 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.156455 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.156626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.156769 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.156932 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.157074 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.157236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.157378 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.157559 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.157682 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.157868 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.157991 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.158199 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.158303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.158472 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.158605 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.158776 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.158935 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.159121 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.159251 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.159429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.159585 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.159771 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.159904 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.160157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.160257 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.160481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.160574 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.160805 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.160905 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.161110 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.161199 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.161423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.161516 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.161734 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.161832 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.162042 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.162145 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.162357 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.162530 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.162686 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.162839 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.162979 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.163126 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.163280 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.163428 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.163574 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.163713 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.164431 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.164531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.164704 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.164796 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.165017 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.165121 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.165330 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.165428 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.165643 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.165741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.165956 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.166047 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.166280 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.166380 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.166595 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.166693 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.166907 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.167005 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.167226 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.167326 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.167541 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.167632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.167880 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.167994 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.168198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.168303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.168514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.168617 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.168823 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.168930 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.169133 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.169241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.169441 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.169545 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.169745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.169843 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.170047 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.170147 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.170352 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.170449 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.170660 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.170751 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.170964 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.171055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.171268 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.171357 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.171570 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.171672 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.171895 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.172011 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.172236 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.172339 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.172511 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.172616 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.172819 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.172910 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.173123 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.173222 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.173427 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.173528 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.173730 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.173821 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.174049 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.174145 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.174361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.174459 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.174669 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.174765 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.174976 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.175074 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.175288 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.175388 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.175612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.175702 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.175947 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.176042 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.176262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.176355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.176569 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.176658 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.176882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.176971 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.177190 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.177287 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.177495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.177591 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.177802 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.177900 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.178110 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.178210 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.178430 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.178551 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.178740 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.178848 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.179059 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.179175 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.179386 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.180017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.180269 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.180375 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.180576 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.180673 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.180889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.180985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.181201 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.181303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.181511 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.181609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.181820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.181911 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.182126 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.182366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.182586 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.182666 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.182751 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.182837 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.183058 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.183211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.183367 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.183466 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.183678 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.183769 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.184014 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.184109 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.184332 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.184431 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.184642 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.184731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.184954 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.185044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.185260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.185357 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.185582 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.185681 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.185892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.185983 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.186205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.186298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.186507 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.186596 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.186820 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.186919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.187132 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.187229 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.187457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.187558 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.187765 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.187886 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.188102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.188193 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.188423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.188544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.188751 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.188840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.189047 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.189144 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.189365 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.189470 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.189672 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.189957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.190062 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.190271 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.190361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.190584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.190674 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.190895 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.190993 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.191205 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.191309 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.191512 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.191601 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.191950 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.192077 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.192165 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.192264 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.192502 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.192592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.192755 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.192862 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.193065 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.193174 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.193386 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.193478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.193689 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.193789 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.194001 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.194100 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.194308 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.194398 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.194610 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.194708 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.194914 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.195034 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.195744 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.195862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.196077 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.196171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.196386 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.196494 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.196690 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.196781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.196996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.197086 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.197313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.197404 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.197621 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.197725 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.197924 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.198016 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.198228 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.198325 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.198552 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.198649 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.198863 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.198965 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.199164 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.199261 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.199471 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.199583 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.199778 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.199940 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.200124 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.200224 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.200441 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.200540 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.200749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.200847 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.201065 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.201163 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.201378 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.201470 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.201689 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.201779 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.202001 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.202103 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.202323 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.202431 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.202633 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.202736 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.202937 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.203037 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.203244 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.203343 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.203546 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.203643 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.203871 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.203982 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.204181 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.204272 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.204494 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.204744 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.204835 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.205082 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.205181 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.205400 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.205497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.205710 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.205800 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.206023 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.206122 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.206341 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.206432 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.206675 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.206773 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.207011 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.207146 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.207342 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.207446 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.207650 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.207766 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.207982 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.208084 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.208296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.208408 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.208602 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.208720 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.208912 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.209043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.209222 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.209324 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.209524 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.209622 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.209832 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.209986 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.210136 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.210289 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.210448 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.210584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.211262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.211413 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.211563 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.211710 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.211871 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.212008 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.212192 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.212336 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.212499 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.212599 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.212819 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.212959 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.213091 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.213213 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.213390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.213477 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.213689 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.213783 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.213993 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.214092 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.214297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.214389 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.214604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.214696 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.214920 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.215933 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.216104 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.216207 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.216301 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.216386 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.216470 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.216568 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.216661 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.216749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.216833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.216916 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.216998 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.217080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.217159 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.217249 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.217333 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.217455 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.217584 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.217761 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.218138 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.218322 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.218448 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.218633 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.218772 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.219010 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.219122 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.219267 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.219389 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.219564 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.219678 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.219910 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.220025 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.220222 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.220324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.220533 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.220710 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.220840 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.220941 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.221150 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.221248 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.221455 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.221556 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.221771 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.221863 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.222084 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.222177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.222391 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.222484 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.222732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.222836 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.223006 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.223123 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.223316 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.223468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.223605 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.223745 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.223952 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.224046 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.224257 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.224348 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.224559 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.224644 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.224956 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.225055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.225162 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.225246 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.225470 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.225560 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.225780 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.225897 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.226086 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.226189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.226449 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.226544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.226774 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.226881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.227087 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.227180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.227393 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.227484 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.227698 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.227799 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.228032 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.228127 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.228338 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.228431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.228644 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.228749 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.228953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.229060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.229269 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.229384 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.229586 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.229687 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.229890 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.230015 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.230198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.230298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.230502 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.230612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.230805 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.230913 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.231108 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.231214 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.231413 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.231520 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.231718 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.231818 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.232048 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.232147 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.232357 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.232456 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.232661 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.232752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.233035 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.233161 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.233273 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.233364 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.233584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.233725 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.233889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.234035 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.234195 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.234350 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.234492 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.234632 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.234832 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.234982 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.235129 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.235268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.235482 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.235618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.235790 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.235933 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.236118 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.236208 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.236436 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.236534 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.236750 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.236844 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.237064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.237154 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.237378 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.237468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.237683 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.237775 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.237997 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.238096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.238307 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.238405 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.238620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.238711 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.238921 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.239011 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.239228 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.239340 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.239533 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.239646 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.239869 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.239985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.240178 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.240298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.240497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.240588 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.240821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.240919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.241145 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.241246 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.241450 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.241548 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.242404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.242564 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.242707 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.242854 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.243022 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.243371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.243536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.243703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.243910 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.244093 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.244257 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.244410 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.244571 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.244730 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.244892 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.245043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.245194 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.245334 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.245481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.245645 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.245822 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.245978 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.246134 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.246287 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.246436 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.246587 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.246753 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.246916 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.247067 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.247227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.247371 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.247500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.247650 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.247793 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.247962 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.248117 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.248117 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.248380 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.248505 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.248636 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.248771 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.248872 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.248965 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.249073 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.249278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.249425 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.249586 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.249694 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.249902 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.250181 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.250335 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.250477 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.250764 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.250968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.251119 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.251283 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.251471 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.251645 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.251780 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.251943 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.252107 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.252279 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.252424 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.252581 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.252729 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.252881 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.253049 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.253187 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.253362 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.253504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.253716 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.253885 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.254067 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.254208 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.254358 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.254464 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.254564 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.254650 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.254733 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.254816 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.254920 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.255011 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.255108 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.255337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.255461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.255655 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.255757 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.255985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.256095 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.256292 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.256473 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.256596 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.256788 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.256941 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.257096 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.257250 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.257532 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.258152 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.258379 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.258486 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.258693 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.258794 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.259018 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.259109 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.259343 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.259447 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.259680 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.259792 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.260015 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.260118 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.260329 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.260432 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.260639 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.260733 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.260949 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.261046 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.261256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.261349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.261568 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.261661 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.261877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.261969 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.262182 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.262287 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.262485 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.262576 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.262801 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.262979 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.263177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.263490 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.263720 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.263877 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.263968 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.264068 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.264160 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.264247 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.264330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.264464 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.264626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.264786 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.264938 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.265117 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.265244 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.265427 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.265551 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.265736 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.265840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.266049 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.266159 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.266356 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.266457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.266663 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.266764 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.266985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.267133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.267274 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.267414 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.267578 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.267724 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.267919 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.268011 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.268232 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.268330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.268540 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.268650 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.268849 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.269021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.269176 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.269336 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.269477 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.269632 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.269849 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.270001 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.270216 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.270375 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.270536 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.270682 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.270817 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.270956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.271102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.271255 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.271396 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.271553 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.271693 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.271846 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.271938 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.272211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.272314 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.272523 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.272614 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.272847 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.272951 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.273186 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.273284 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.273502 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.273680 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.273821 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.273982 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.274133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.274229 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.274447 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.274542 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.274760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.274865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.275072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.275185 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.275386 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.275498 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.275702 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.275802 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.276053 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.276138 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.276361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.276442 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.276665 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.276766 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.276973 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.277072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.277278 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.277379 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.277583 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.277684 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.277887 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.277987 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.278193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.278294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.278497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.278588 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.278800 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.278898 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.279103 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.279208 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.279430 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.279521 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.279735 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.279850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.280072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.280202 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.280378 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.280476 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.280683 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.280776 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.280989 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.281081 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.281293 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.281384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.281602 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.281700 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.281919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.282011 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.282233 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.282323 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.282551 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.282639 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.282876 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.282977 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.283194 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.283292 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.283502 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.283612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.283817 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.283978 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.284154 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.284252 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.284526 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.284681 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.284842 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.284996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.285148 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.285317 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.285484 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.285641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.285783 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.285961 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.286099 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.286281 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.286417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.286601 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.286752 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.286931 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.287075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.287234 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.287390 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.287542 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.287782 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.287922 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.288139 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.288241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.288445 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.288537 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.288775 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.288876 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.289093 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.289184 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.289402 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.289503 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.289714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.289811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.290023 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.290126 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.290333 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.290566 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.290658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.290919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.291017 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.291240 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.291332 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.291570 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.291669 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.291916 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.292010 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.292238 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.292332 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.292548 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.292648 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.292862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.292955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.293171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.293262 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.293481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.293573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.293801 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.293941 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.294118 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.294236 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.294428 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.294529 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.294736 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.294849 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.295048 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.295149 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.295357 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.295457 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.295665 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.295785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.295997 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.296090 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.296305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.296405 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.296617 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.296708 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.296925 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.297015 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.297230 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.297322 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.297536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.297637 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.297846 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.297943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.298150 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.298241 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.298455 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.298547 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.298759 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.298859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.299061 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.299163 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.299373 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.299467 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.299678 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.299760 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.300771 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.300878 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.300955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.301035 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.301347 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.301432 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.301515 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.301667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.302268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.302345 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.302417 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.302488 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.302574 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.302574 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.302574 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.302777 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.302856 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.302940 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.303019 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.303505 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.303603 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.303687 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.303759 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.303907 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.304004 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.304079 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.304300 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.304949 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.305154 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.305262 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.305525 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.305754 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.305855 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.306441 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.306554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.306654 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.306740 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.306825 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.307024 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.307139 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.307317 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.307424 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.307691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.307792 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.307985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.308081 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.308313 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.308406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.308633 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.308765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.308943 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.309042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.309267 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.309358 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.309572 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.309664 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.309881 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.309981 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.310192 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.310284 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.310501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.310598 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.310809 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.310957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.311117 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.311210 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.311425 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.311522 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.311734 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.311855 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.312067 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.312161 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.312376 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.312467 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.312680 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.312781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.313005 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.313111 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.313365 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.313468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.313716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.313793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.313984 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.314088 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.314269 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.314375 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.314579 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.314684 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.314883 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.314976 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.315569 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.315691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.315691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.324196 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.324303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.324393 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.324479 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.324577 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.324683 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.324769 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.324853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.324944 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.325044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.325044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.325207 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.325292 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.325374 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.325465 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.325563 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.325835 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.325932 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.326019 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.326104 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.326188 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.326285 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.326371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.326462 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.326563 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.326650 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.326748 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.326834 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.326927 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.327018 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.327102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.327193 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.327298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.327385 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.327469 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.327552 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.327635 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.327823 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.327990 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.328087 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.328179 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.328271 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.328371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.328459 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.328552 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.328645 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.328740 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.328833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.328919 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.329012 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.329099 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.329182 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.329266 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.329349 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.329439 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.329538 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.329624 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.329715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.329800 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.329884 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.329974 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.330070 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.330155 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.330238 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.330321 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.330412 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.330486 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.330566 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.330651 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.330740 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.330831 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.330923 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.331020 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.331106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.331196 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.331290 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.331375 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.331466 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.331602 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.331696 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.331800 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.331909 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.331909 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.332072 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.332184 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.332273 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.332362 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.332445 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.332536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.332633 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.332718 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.332808 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.332808 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.332965 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.333048 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.333210 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.333305 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.333390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.333462 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.333532 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.333620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.333714 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.333806 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.333918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.334010 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.334102 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.334194 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.334293 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.334293 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.334465 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.334552 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.334635 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.334732 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.334819 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.334902 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.334993 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.335077 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.335160 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.335257 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.335342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.335426 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.335508 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.335593 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.335704 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.335951 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.336064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.336152 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.336241 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.336334 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.336429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.336735 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.336951 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.337055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.337293 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.337392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.337608 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.337749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.337922 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.338231 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.338377 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.338598 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.338714 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.338853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.339017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.339172 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.339333 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.339484 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.339646 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.339791 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.340004 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.340116 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.340319 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.340425 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.340634 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.340735 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.340952 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.341052 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.341268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.341374 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.341582 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.341673 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.341892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.341983 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.342242 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.342359 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.342498 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.342600 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.342801 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.343153 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.343360 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.343459 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.343664 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.343755 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.343991 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.345009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.345116 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.345210 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.345303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.345382 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.345481 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.345575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.345669 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.345755 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.345844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.345928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 11:23:50.346024 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.346125 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.346390 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.346702 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.347022 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.347334 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.347658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.348029 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.348311 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.348651 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.348957 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.349269 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.349603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.349915 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.350227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.350540 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.350851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.351162 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.351498 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.351873 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.352176 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.352498 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.352811 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.353131 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.353450 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.353843 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.354159 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.354490 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.354801 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.355108 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.355421 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.355732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.356091 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.356378 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.356694 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.357022 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.357347 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.357655 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.357981 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.358307 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.358661 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.358977 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.359324 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.359651 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.359997 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.360314 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.360617 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:23:50.360859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 11:23:50.409705 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] Registered counter for database nova_api Jun 29 11:23:50.423299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO dbcounter [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] Registered counter for database nova_api Jun 29 11:23:50.430338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:23:50.436969 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:23:50.443459 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_db.sqlalchemy.engines [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:23:50.450573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writer thread running {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:23:50.494018 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.context [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbe1565e-37f2-43ef-a64f-991bc8fd407f(cell1) {{(pid=117920) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 11:23:50.498126 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:23:50.499740 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:23:50.500554 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:23:50.502513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:23:50.504530 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] Registered counter for database nova_cell0 Jun 29 11:23:50.506216 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.context [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbe1565e-37f2-43ef-a64f-991bc8fd407f(cell1) {{(pid=117921) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 11:23:50.509306 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] Registered counter for database nova_cell1 Jun 29 11:23:50.510953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:23:50.512590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:23:50.513390 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:23:50.515382 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:23:50.516368 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:23:50.517449 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO dbcounter [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] Registered counter for database nova_cell0 Jun 29 11:23:50.518589 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:23:50.521498 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO dbcounter [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] Registered counter for database nova_cell1 Jun 29 11:23:50.526484 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:23:50.526821 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:23:50.528164 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_db.sqlalchemy.engines [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:23:50.534018 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writer thread running {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:23:50.535423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_db.sqlalchemy.engines [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:23:50.676094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] Registered counter for database nova_cell0 Jun 29 11:23:50.683439 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:23:50.684389 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writer thread running {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:23:50.688001 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:23:50.693586 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO dbcounter [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] Registered counter for database nova_cell0 Jun 29 11:23:50.700452 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_db.sqlalchemy.engines [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:23:50.705270 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writer thread running {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:23:51.014345 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 11:23:51.021789 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 11:23:51.026833 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: WARNING keystonemiddleware.auth_token [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 11:23:51.034042 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: WARNING keystonemiddleware.auth_token [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 11:23:51.384624 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: WARNING keystonemiddleware.auth_token [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 11:23:51.388221 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 11:23:51.390701 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: WARNING keystonemiddleware.auth_token [None req-cd3bd389-93ec-42d3-a0f0-7f87191052de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 11:23:51.394371 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-ae0d653c-de7d-4d92-88fc-75eb66493aa6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 11:23:51.396047 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d21ecae9c0 pid: 117921 (default app) Jun 29 11:23:51.400320 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d21ecae9c0 pid: 117920 (default app) Jun 29 11:24:33.312216 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:33.321293 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:33.325471 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:33.325471 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:33.516018 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:33.517623 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:33.519732 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:33.521654 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:35.020139 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-baa94a48-1388-4d7d-afb4-9cfb5e20fe5e tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Action: 'create', calling method: .version_select at 0x7fd08b609430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1326354490"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:24:35.146836 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9ef9c39a-325c-48f0-82d7-95ccca7bb0ed tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Action: 'create', calling method: .version_select at 0x7fd08b6083a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-285542533", "metadata": {"Type": "work"}}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9ef9c39a-325c-48f0-82d7-95ccca7bb0ed tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Request method failure captured: Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 121 Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZxqJYOkBx-Kg4D4R82SqmZduBj6J6H7GVo2VMcQwFbvkpdvKh39AOZXh3iJLFXomuB-l7EnjSoluuZBip5492oDNiRMISPPI4kHCDJgWCCuAr4rHZSHHnuDSgboKIDTsIhx4MhYI4K534Vqe28m690hjbflRYR4EPZdpPJy0Aoggw Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 6815b6ed40654b9cb7ab3567b3f752a1 Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:24:35.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6815b6ed40654b9cb7ab3567b3f752a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6815b6ed40654b9cb7ab3567b3f752a1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6815b6ed40654b9cb7ab3567b3f752a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6815b6ed40654b9cb7ab3567b3f752a1"}]}] Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 6815b6ed40654b9cb7ab3567b3f752a1 Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1990105202-project Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 61eadda6693f47b680fb2083bf8bd573 Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1990105202-project Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-285542533", "metadata": {"Type": "work"}}} Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: Jun 29 11:24:35.168477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-285542533', 'metadata': {'Type': 'work'}}}} Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise error Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi '#$%' Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:24:35.169346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 11:24:35.170887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 11:24:35.172760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 11:24:35.172760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.172760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9ef9c39a-325c-48f0-82d7-95ccca7bb0ed tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:24:35.172760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9ef9c39a-325c-48f0-82d7-95ccca7bb0ed tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.659732 Jun 29 11:24:35.172760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1155 bytes} [Wed Jun 29 11:24:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1663 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 11:24:35.197106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2c48d9f0-9e56-45da-9ace-9210b6638fcb tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Action: 'create', calling method: .version_select at 0x7fd08b5b3700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1349584878", "metadata": {"Type": "work"}}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2c48d9f0-9e56-45da-9ace-9210b6638fcb tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Request method failure captured: Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 120 Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZxqJYOkBx-Kg4D4R82SqmZduBj6J6H7GVo2VMcQwFbvkpdvKh39AOZXh3iJLFXomuB-l7EnjSoluuZBip5492oDNiRMISPPI4kHCDJgWCCuAr4rHZSHHnuDSgboKIDTsIhx4MhYI4K534Vqe28m690hjbflRYR4EPZdpPJy0Aoggw Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 6815b6ed40654b9cb7ab3567b3f752a1 Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:24:35.199814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6815b6ed40654b9cb7ab3567b3f752a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6815b6ed40654b9cb7ab3567b3f752a1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6815b6ed40654b9cb7ab3567b3f752a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6815b6ed40654b9cb7ab3567b3f752a1"}]}] Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 6815b6ed40654b9cb7ab3567b3f752a1 Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1990105202-project Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 61eadda6693f47b680fb2083bf8bd573 Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1990105202-project Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1349584878", "metadata": {"Type": "work"}}} Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: Jun 29 11:24:35.201536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1349584878', 'metadata': {'Type': 'work'}}}} Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise error Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi '0' Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:24:35.202372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 11:24:35.204468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 11:24:35.206277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 11:24:35.206277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.206277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2c48d9f0-9e56-45da-9ace-9210b6638fcb tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:24:35.206677 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2c48d9f0-9e56-45da-9ace-9210b6638fcb tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016511 Jun 29 11:24:35.219598 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 2/2] 10.222.0.44 () {60 vars in 1155 bytes} [Wed Jun 29 11:24:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 11:24:35.221327 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2b70a64-4a83-4b93-8b87-6670ae87e5e4 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Action: 'create', calling method: .version_select at 0x7fd08b608700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-615972427", "metadata": {"Type": "work"}}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2b70a64-4a83-4b93-8b87-6670ae87e5e4 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Request method failure captured: Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 118 Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZxqJYOkBx-Kg4D4R82SqmZduBj6J6H7GVo2VMcQwFbvkpdvKh39AOZXh3iJLFXomuB-l7EnjSoluuZBip5492oDNiRMISPPI4kHCDJgWCCuAr4rHZSHHnuDSgboKIDTsIhx4MhYI4K534Vqe28m690hjbflRYR4EPZdpPJy0Aoggw Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 6815b6ed40654b9cb7ab3567b3f752a1 Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:24:35.225929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6815b6ed40654b9cb7ab3567b3f752a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6815b6ed40654b9cb7ab3567b3f752a1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6815b6ed40654b9cb7ab3567b3f752a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6815b6ed40654b9cb7ab3567b3f752a1"}]}] Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 6815b6ed40654b9cb7ab3567b3f752a1 Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1990105202-project Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 61eadda6693f47b680fb2083bf8bd573 Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1990105202-project Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-615972427", "metadata": {"Type": "work"}}} Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: Jun 29 11:24:35.227429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-615972427', 'metadata': {'Type': 'work'}}}} Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise error Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi '' Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:24:35.229082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 11:24:35.230618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 11:24:35.232037 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 11:24:35.232037 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:35.232037 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2b70a64-4a83-4b93-8b87-6670ae87e5e4 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:24:35.232037 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2b70a64-4a83-4b93-8b87-6670ae87e5e4 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013692 Jun 29 11:24:35.239854 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 3/3] 10.222.0.44 () {60 vars in 1155 bytes} [Wed Jun 29 11:24:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 11:24:35.260010 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-609b6148-dba1-479b-b131-be65918f7090 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Calling method '.version_select at 0x7fd08b535430>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:36.400947 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-609b6148-dba1-479b-b131-be65918f7090 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] HTTP exception thrown: Volume tempest-invalid-1547636294 could not be found. Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-609b6148-dba1-479b-b131-be65918f7090 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Request method failure captured: Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1547636294 HTTP/1.1 Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZxqJYOkBx-Kg4D4R82SqmZduBj6J6H7GVo2VMcQwFbvkpdvKh39AOZXh3iJLFXomuB-l7EnjSoluuZBip5492oDNiRMISPPI4kHCDJgWCCuAr4rHZSHHnuDSgboKIDTsIhx4MhYI4K534Vqe28m690hjbflRYR4EPZdpPJy0Aoggw Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 6815b6ed40654b9cb7ab3567b3f752a1 Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:24:36.417517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6815b6ed40654b9cb7ab3567b3f752a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6815b6ed40654b9cb7ab3567b3f752a1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6815b6ed40654b9cb7ab3567b3f752a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6815b6ed40654b9cb7ab3567b3f752a1"}]}] Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 6815b6ed40654b9cb7ab3567b3f752a1 Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1990105202-project Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 61eadda6693f47b680fb2083bf8bd573 Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1990105202-project Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Volume tempest-invalid-1547636294 could not be found. Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': 'tempest-invalid-1547636294'} Jun 29 11:24:36.419106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1547636294 could not be found. (HTTP 404) (Request-ID: req-1a17b6ff-bca8-4aa5-adea-0116718a5d37) Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:36.420188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 11:24:36.421612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1547636294 could not be found. Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:24:36.422928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1547636294 could not be found. Jun 29 11:24:36.432355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:36.432355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:36.432355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:36.432355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:36.432355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:36.432355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:36.432355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:24:36.432355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:24:36.432355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1547636294 could not be found. Jun 29 11:24:36.432355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:36.432355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-609b6148-dba1-479b-b131-be65918f7090 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Returning 404 to user: Volume tempest-invalid-1547636294 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:24:36.435224 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-609b6148-dba1-479b-b131-be65918f7090 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1547636294" status: 404 len: 99 microversion: 2.1 time: 1.191058 Jun 29 11:24:36.436013 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 4/4] 10.222.0.44 () {58 vars in 1217 bytes} [Wed Jun 29 11:24:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1547636294 => generated 99 bytes in 1196 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 29 11:24:36.453442 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-05e9b904-448f-40f2-817f-bd76bbcb9c7a tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004933 Jun 29 11:24:36.456059 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 5/5] 10.222.0.44 () {58 vars in 1139 bytes} [Wed Jun 29 11:24:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 29 11:24:36.473997 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4fa52407-5401-4d7e-852b-e5e599b47ddc tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004706 Jun 29 11:24:36.475958 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 6/6] 10.222.0.44 () {58 vars in 1136 bytes} [Wed Jun 29 11:24:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 29 11:24:36.493853 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-244c3cb6-1ce3-46a6-b6e7-7ced83eee2e7 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Calling method '.version_select at 0x7fd08b460700>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:37.245967 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-244c3cb6-1ce3-46a6-b6e7-7ced83eee2e7 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] HTTP exception thrown: Volume 7f28a968-6f9a-4910-af32-cfb59923588b could not be found. Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-244c3cb6-1ce3-46a6-b6e7-7ced83eee2e7 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Request method failure captured: Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/os-volumes/7f28a968-6f9a-4910-af32-cfb59923588b HTTP/1.1 Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZxqJYOkBx-Kg4D4R82SqmZduBj6J6H7GVo2VMcQwFbvkpdvKh39AOZXh3iJLFXomuB-l7EnjSoluuZBip5492oDNiRMISPPI4kHCDJgWCCuAr4rHZSHHnuDSgboKIDTsIhx4MhYI4K534Vqe28m690hjbflRYR4EPZdpPJy0Aoggw Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 6815b6ed40654b9cb7ab3567b3f752a1 Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:24:37.250064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6815b6ed40654b9cb7ab3567b3f752a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6815b6ed40654b9cb7ab3567b3f752a1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6815b6ed40654b9cb7ab3567b3f752a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6815b6ed40654b9cb7ab3567b3f752a1"}]}] Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 6815b6ed40654b9cb7ab3567b3f752a1 Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1990105202-project Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 61eadda6693f47b680fb2083bf8bd573 Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1990105202-project Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Volume 7f28a968-6f9a-4910-af32-cfb59923588b could not be found. Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '7f28a968-6f9a-4910-af32-cfb59923588b'} Jun 29 11:24:37.251760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f28a968-6f9a-4910-af32-cfb59923588b could not be found. (HTTP 404) (Request-ID: req-c8cffb67-fab9-47c2-ad0c-a409dae94b67) Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:37.252731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 11:24:37.253850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f28a968-6f9a-4910-af32-cfb59923588b could not be found. Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 11:24:37.254963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:24:37.259189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f28a968-6f9a-4910-af32-cfb59923588b could not be found. Jun 29 11:24:37.259189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.259189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:37.259189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.259189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:37.259189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:37.259189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:37.259189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:24:37.259189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:24:37.259189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f28a968-6f9a-4910-af32-cfb59923588b could not be found. Jun 29 11:24:37.259189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.262523 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-244c3cb6-1ce3-46a6-b6e7-7ced83eee2e7 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Returning 404 to user: Volume 7f28a968-6f9a-4910-af32-cfb59923588b could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:24:37.263622 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-244c3cb6-1ce3-46a6-b6e7-7ced83eee2e7 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/7f28a968-6f9a-4910-af32-cfb59923588b" status: 404 len: 109 microversion: 2.1 time: 0.777440 Jun 29 11:24:37.264751 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 7/7] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jun 29 11:24:36 2022] DELETE /compute/v2.1/os-volumes/7f28a968-6f9a-4910-af32-cfb59923588b => generated 109 bytes in 779 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:24:37.297197 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c3869f1b-8a33-47ed-8c5d-92086969d4e0 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Calling method '.version_select at 0x7fd08b5b3f70>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:37.819858 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-baa94a48-1388-4d7d-afb4-9cfb5e20fe5e tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.330199 Jun 29 11:24:37.819858 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 1/8] 10.222.0.44 () {60 vars in 1154 bytes} [Wed Jun 29 11:24:33 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4337 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 29 11:24:37.819858 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5e76d228-2ff1-48ba-8f7c-dd3e18159664 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b4d0310>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-c3869f1b-8a33-47ed-8c5d-92086969d4e0 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] HTTP exception thrown: Volume a7edbe8c-4802-45c4-a3ff-9f0011098425 could not be found. Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c3869f1b-8a33-47ed-8c5d-92086969d4e0 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Request method failure captured: Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/os-volumes/a7edbe8c-4802-45c4-a3ff-9f0011098425 HTTP/1.1 Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZxqJYOkBx-Kg4D4R82SqmZduBj6J6H7GVo2VMcQwFbvkpdvKh39AOZXh3iJLFXomuB-l7EnjSoluuZBip5492oDNiRMISPPI4kHCDJgWCCuAr4rHZSHHnuDSgboKIDTsIhx4MhYI4K534Vqe28m690hjbflRYR4EPZdpPJy0Aoggw Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 6815b6ed40654b9cb7ab3567b3f752a1 Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:24:37.828231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6815b6ed40654b9cb7ab3567b3f752a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6815b6ed40654b9cb7ab3567b3f752a1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6815b6ed40654b9cb7ab3567b3f752a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6815b6ed40654b9cb7ab3567b3f752a1"}]}] Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 6815b6ed40654b9cb7ab3567b3f752a1 Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1990105202 Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1990105202-project Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 61eadda6693f47b680fb2083bf8bd573 Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1990105202-project Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Volume a7edbe8c-4802-45c4-a3ff-9f0011098425 could not be found. Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': 'a7edbe8c-4802-45c4-a3ff-9f0011098425'} Jun 29 11:24:37.834096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7edbe8c-4802-45c4-a3ff-9f0011098425 could not be found. (HTTP 404) (Request-ID: req-7742db9e-9996-4797-ba82-b33b86a58ce8) Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:37.840663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 11:24:37.842797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7edbe8c-4802-45c4-a3ff-9f0011098425 could not be found. Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 11:24:37.847390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7edbe8c-4802-45c4-a3ff-9f0011098425 could not be found. Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7edbe8c-4802-45c4-a3ff-9f0011098425 could not be found. Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c3869f1b-8a33-47ed-8c5d-92086969d4e0 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] Returning 404 to user: Volume a7edbe8c-4802-45c4-a3ff-9f0011098425 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c3869f1b-8a33-47ed-8c5d-92086969d4e0 tempest-VolumesNegativeTest-1990105202 tempest-VolumesNegativeTest-1990105202-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a7edbe8c-4802-45c4-a3ff-9f0011098425" status: 404 len: 109 microversion: 2.1 time: 0.390186 Jun 29 11:24:37.850641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 8/9] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:24:37 2022] GET /compute/v2.1/os-volumes/a7edbe8c-4802-45c4-a3ff-9f0011098425 => generated 109 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:24:38.146758 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5e76d228-2ff1-48ba-8f7c-dd3e18159664 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 200 len: 345 microversion: 2.1 time: 0.509818 Jun 29 11:24:38.147329 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 2/10] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:24:37 2022] GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 345 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:39.160640 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cafe4662-9452-453f-9b11-6790086157f6 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b460160>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:39.284760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cafe4662-9452-453f-9b11-6790086157f6 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 200 len: 345 microversion: 2.1 time: 0.128555 Jun 29 11:24:39.285506 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 9/11] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:24:39 2022] GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 345 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:40.310897 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2c405779-836d-46d9-9ef9-7452ca438c0c tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b4d0430>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:40.459502 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2c405779-836d-46d9-9ef9-7452ca438c0c tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 200 len: 346 microversion: 2.1 time: 0.161118 Jun 29 11:24:40.459502 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 3/12] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:24:40 2022] GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 346 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:40.467414 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a2f0a613-aa56-436c-beb6-d167e78ac497 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Action: 'create', calling method: .version_select at 0x7fd08b5b3b80>, body: {"snapshot": {"volume_id": "c24dba68-8b96-42da-88d3-6bd581ed4b7e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-965065026"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:24:41.486445 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a2f0a613-aa56-436c-beb6-d167e78ac497 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.022887 Jun 29 11:24:41.487941 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 10/13] 10.222.0.44 () {60 vars in 1161 bytes} [Wed Jun 29 11:24:40 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:41.499363 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-24d12e17-00bb-4637-9d38-23924a6cb974 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b4d0a60>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:41.575009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-24d12e17-00bb-4637-9d38-23924a6cb974 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 286 microversion: 2.1 time: 0.080878 Jun 29 11:24:41.581209 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 4/14] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:41 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:41.586659 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-50369a95-1615-4ef7-921c-7269a258ba16 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b460d30>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:41.735597 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-50369a95-1615-4ef7-921c-7269a258ba16 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.153482 Jun 29 11:24:41.736515 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 11/15] 10.222.0.44 () {58 vars in 1139 bytes} [Wed Jun 29 11:24:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:41.748271 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2fb6f5d3-fd61-4a34-9c64-7b4b1d3abfc6 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b4ec1f0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:41.817757 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2fb6f5d3-fd61-4a34-9c64-7b4b1d3abfc6 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 286 microversion: 2.1 time: 0.075002 Jun 29 11:24:41.819089 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 5/16] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:41 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:42.830015 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-10f0be12-74a5-48b6-9817-a80b94ad72b9 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b473a60>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:43.002262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-10f0be12-74a5-48b6-9817-a80b94ad72b9 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 286 microversion: 2.1 time: 0.175817 Jun 29 11:24:43.003012 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 12/17] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:42 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:44.015879 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-51aaeacb-7432-463e-ad5e-3f257aefe5f1 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b4601f0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:44.101382 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-98083851", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "networks": [{"uuid": "69356792-2a95-4756-b1f3-e8a7d874a9f7"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:24:44.105379 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-51aaeacb-7432-463e-ad5e-3f257aefe5f1 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 286 microversion: 2.1 time: 0.094893 Jun 29 11:24:44.106221 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 13/18] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:44 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:24:44.326343 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] validate_networks() for [('69356792-2a95-4756-b1f3-e8a7d874a9f7', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:24:45.117109 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf919cd2-c3c9-4bf5-ad5f-b1f0f18e67bc tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b5b3ca0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:45.193226 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf919cd2-c3c9-4bf5-ad5f-b1f0f18e67bc tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 286 microversion: 2.1 time: 0.079889 Jun 29 11:24:45.196571 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 14/19] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:45 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:46.204939 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1cd9ded7-85ba-4a27-89aa-989fb3a325f8 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b487b80>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:46.270317 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1cd9ded7-85ba-4a27-89aa-989fb3a325f8 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 286 microversion: 2.1 time: 0.069151 Jun 29 11:24:46.271190 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 15/20] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:46 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:46.798476 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:24:46.798950 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:24:46.799421 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:24:46.799875 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:24:46.802100 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:24:46.839367 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:46.840833 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:46.841642 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:46.846877 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:46.951360 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Getting quotas for project 07bc0c697e63498799ecf2a0335eae46. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:24:46.980476 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Getting quotas for user b1ca7ff32b434abc8d036ddfa266a584 and project 07bc0c697e63498799ecf2a0335eae46. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:24:46.998737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:24:47.000788 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:24:47.211808 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a3cd0d23-17b7-4428-835b-aa5347306a94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.610309 Jun 29 11:24:47.212586 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 6/21] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:24:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:24:47.222445 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-76018baf-54e0-446a-90fd-3c4305f14544 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Action: 'create', calling method: .version_select at 0x7fd08b4739d0>, body: {"keypair": {"name": "tempest-keypair-86607036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhFmqDXDyH6zlxUk11FRJM7Lixy1oZpOfJtgAxMj/iTDNsHLKEIR/ZIxTVN0PE2hUgHml4iKnXum2xeYarnnG/3MHON9sL3vtdP9PlOJ+ZoCw06X90pgf5ge5swFmmTPw=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:24:47.232617 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-03685fff-b4a6-4f0b-b039-732cd4ccd1e8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:47.233526 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-03685fff-b4a6-4f0b-b039-732cd4ccd1e8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:47.425817 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-76018baf-54e0-446a-90fd-3c4305f14544 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Getting quotas for project 2c08a3d7e74f45999d1ba0ab11781458. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:24:47.448024 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-03685fff-b4a6-4f0b-b039-732cd4ccd1e8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:47.448623 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-76018baf-54e0-446a-90fd-3c4305f14544 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Getting quotas for user f75e0b3528b14856b73dc441c52d1d73 and project 2c08a3d7e74f45999d1ba0ab11781458. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:24:47.472957 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-03685fff-b4a6-4f0b-b039-732cd4ccd1e8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1213 microversion: 2.1 time: 0.250749 Jun 29 11:24:47.476787 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 7/22] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:47 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1213 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:47.486034 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bf21d22a-3ffe-4a75-a506-9b346dc14f53 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b3f7310>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:47.616527 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bf21d22a-3ffe-4a75-a506-9b346dc14f53 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 286 microversion: 2.1 time: 0.135979 Jun 29 11:24:47.620977 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 8/23] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:47 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:47.644335 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-76018baf-54e0-446a-90fd-3c4305f14544 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.126745 Jun 29 11:24:47.645523 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 16/24] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jun 29 11:24:46 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:48.267725 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2077435325", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:24:48.390170 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] validate_networks() for [('93470ed8-676b-48ec-9a1b-1a10fe6a5a42', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:24:48.494638 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8b58e143-c005-4fc5-aeac-86c8b2afcc3d tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:48.495330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8b58e143-c005-4fc5-aeac-86c8b2afcc3d tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:48.606149 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8b58e143-c005-4fc5-aeac-86c8b2afcc3d tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:48.631913 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8b58e143-c005-4fc5-aeac-86c8b2afcc3d tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1213 microversion: 2.1 time: 0.141922 Jun 29 11:24:48.635206 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 17/25] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:48 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:24:48.640233 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f1b7854-1d93-4f0d-9bd3-2432e6d48ec8 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b468e50>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:48.683876 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8f1b7854-1d93-4f0d-9bd3-2432e6d48ec8 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 287 microversion: 2.1 time: 0.047231 Jun 29 11:24:48.684430 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 18/26] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:48 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:48.702052 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ff312453-48e1-4809-b978-b2d70917cc57 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08ab434c0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:48.935979 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ff312453-48e1-4809-b978-b2d70917cc57 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 202 len: 0 microversion: 2.1 time: 0.238465 Jun 29 11:24:48.939763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 19/27] 10.222.0.44 () {58 vars in 1253 bytes} [Wed Jun 29 11:24:48 2022] DELETE /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:24:48.945086 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-060e2518-1bce-4e5b-a758-16c0469ebaa2 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b4608b0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:49.085285 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:24:49.085712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:24:49.086724 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:24:49.087134 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:24:49.087545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:24:49.097332 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:49.098000 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:49.099005 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:49.100116 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:49.118449 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Getting quotas for project cbfba915f70342afb8267e34abc24bfe. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:24:49.122438 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Getting quotas for user 8effcd6f6be64f14b3c8bc71f8866a99 and project cbfba915f70342afb8267e34abc24bfe. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:24:49.162639 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:24:49.165239 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:24:49.350007 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-95d6460e-fb7f-40d1-a860-10ae9d8eed60 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.360730 Jun 29 11:24:49.353882 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 9/28] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:24:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:24:49.364737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f1752251-fc64-4cc3-8147-f2e9398b8052 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:49.365687 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f1752251-fc64-4cc3-8147-f2e9398b8052 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:49.485450 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f1752251-fc64-4cc3-8147-f2e9398b8052 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:49.495123 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f1752251-fc64-4cc3-8147-f2e9398b8052 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1222 microversion: 2.1 time: 0.134577 Jun 29 11:24:49.497525 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 10/29] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:49 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:24:49.501720 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-060e2518-1bce-4e5b-a758-16c0469ebaa2 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 286 microversion: 2.1 time: 0.560381 Jun 29 11:24:49.502310 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 20/30] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:48 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 286 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:49.599486 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1538733813", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:24:49.655536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-08b22ad1-fd15-4586-9bfc-270d95e9b03e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:49.656441 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-08b22ad1-fd15-4586-9bfc-270d95e9b03e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:49.741273 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] validate_networks() for [('93470ed8-676b-48ec-9a1b-1a10fe6a5a42', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:24:50.040313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08b22ad1-fd15-4586-9bfc-270d95e9b03e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:50.040313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-08b22ad1-fd15-4586-9bfc-270d95e9b03e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1213 microversion: 2.1 time: 0.327585 Jun 29 11:24:50.040313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 21/31] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:49 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1213 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:50.523477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf6be0d5-b0f4-496b-9c3c-4acccfb0cfae tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b468ee0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:50.524080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:24:50.524477 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:24:50.524772 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:24:50.525216 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:24:50.525628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:24:50.565746 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:50.566271 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:50.566990 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:50.567426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:50.586863 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf6be0d5-b0f4-496b-9c3c-4acccfb0cfae tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 286 microversion: 2.1 time: 0.067875 Jun 29 11:24:50.588762 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 22/32] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:50 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:50.607206 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Getting quotas for project cbfba915f70342afb8267e34abc24bfe. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:24:50.612091 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Getting quotas for user 8effcd6f6be64f14b3c8bc71f8866a99 and project cbfba915f70342afb8267e34abc24bfe. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:24:50.628263 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:24:50.630899 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:24:50.810131 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6bca18c0-4f6d-40c5-8463-34cfe1950ceb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.222035 Jun 29 11:24:50.811080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 11/33] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:24:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:24:50.821662 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-67bd5766-b231-4dec-b372-4ba7c6bf234d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:50.822869 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-67bd5766-b231-4dec-b372-4ba7c6bf234d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:50.977986 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-67bd5766-b231-4dec-b372-4ba7c6bf234d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:50.997440 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-67bd5766-b231-4dec-b372-4ba7c6bf234d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1222 microversion: 2.1 time: 0.180500 Jun 29 11:24:51.001316 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 23/34] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:50 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:51.040931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0ba84b39-1c7f-47bd-bd27-af664a22530e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:51.042290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0ba84b39-1c7f-47bd-bd27-af664a22530e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:51.057420 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0ba84b39-1c7f-47bd-bd27-af664a22530e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:51.059371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0ba84b39-1c7f-47bd-bd27-af664a22530e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:51.060652 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0ba84b39-1c7f-47bd-bd27-af664a22530e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:51.062696 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0ba84b39-1c7f-47bd-bd27-af664a22530e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:51.280592 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0ba84b39-1c7f-47bd-bd27-af664a22530e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:51.293499 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0ba84b39-1c7f-47bd-bd27-af664a22530e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1217 microversion: 2.1 time: 0.258316 Jun 29 11:24:51.305684 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 12/35] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:51 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1217 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:51.604440 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4a3434f9-554c-4da0-aaaa-75c8ee24c6d8 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08b5b3c10>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:51.713316 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4a3434f9-554c-4da0-aaaa-75c8ee24c6d8 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 286 microversion: 2.1 time: 0.116490 Jun 29 11:24:51.714501 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 24/36] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:51 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:51.858088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-164259848", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6647f91c-fe8e-4ab8-91a0-0e32da329b78"}], "security_groups": [{"name": "tempest-securitygroup--1190018780"}], "key_name": "tempest-keypair-86607036", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:24:52.032695 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2d68d94b-56bc-4a74-926b-5e25acaecd0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:52.035079 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2d68d94b-56bc-4a74-926b-5e25acaecd0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:52.045179 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] validate_networks() for [('6647f91c-fe8e-4ab8-91a0-0e32da329b78', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:24:52.061896 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2d68d94b-56bc-4a74-926b-5e25acaecd0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:52.064184 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2d68d94b-56bc-4a74-926b-5e25acaecd0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:52.067055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2d68d94b-56bc-4a74-926b-5e25acaecd0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:52.074182 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2d68d94b-56bc-4a74-926b-5e25acaecd0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:52.460310 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2d68d94b-56bc-4a74-926b-5e25acaecd0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:52.494854 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2d68d94b-56bc-4a74-926b-5e25acaecd0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1226 microversion: 2.1 time: 0.476498 Jun 29 11:24:52.495610 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 25/37] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:52 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1226 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:52.505530 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b0a42d3a-e3fc-46d5-9db1-1427fcdb18d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:52.505530 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b0a42d3a-e3fc-46d5-9db1-1427fcdb18d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:52.511605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0a42d3a-e3fc-46d5-9db1-1427fcdb18d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:52.512376 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0a42d3a-e3fc-46d5-9db1-1427fcdb18d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:52.513730 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0a42d3a-e3fc-46d5-9db1-1427fcdb18d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:52.514370 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0a42d3a-e3fc-46d5-9db1-1427fcdb18d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:52.642674 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b0a42d3a-e3fc-46d5-9db1-1427fcdb18d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:52.653823 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b0a42d3a-e3fc-46d5-9db1-1427fcdb18d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1217 microversion: 2.1 time: 0.157018 Jun 29 11:24:52.663660 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 26/38] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:52 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:52.726086 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-667ccd29-91cb-49f7-97a1-4fc398ae6b45 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08aaf4670>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:52.809887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-667ccd29-91cb-49f7-97a1-4fc398ae6b45 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 286 microversion: 2.1 time: 0.087864 Jun 29 11:24:52.810797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 27/39] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:52 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:52.855214 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:24:52.855701 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:24:52.856200 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:24:52.856611 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:24:52.857026 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:24:52.873961 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:52.873961 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:52.873961 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:52.873961 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:52.934812 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Getting quotas for project 2c08a3d7e74f45999d1ba0ab11781458. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:24:52.943573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Getting quotas for user f75e0b3528b14856b73dc441c52d1d73 and project 2c08a3d7e74f45999d1ba0ab11781458. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:24:52.960274 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:24:52.973130 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:24:53.120749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-06c5008a-6822-461d-ae99-f53673f39bef tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.268188 Jun 29 11:24:53.126729 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 13/40] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:24:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:24:53.134987 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-60dcf201-25f0-41b9-b3b3-c95c616a8f01 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:53.135544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-60dcf201-25f0-41b9-b3b3-c95c616a8f01 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:53.275920 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-60dcf201-25f0-41b9-b3b3-c95c616a8f01 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:53.284658 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-60dcf201-25f0-41b9-b3b3-c95c616a8f01 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1235 microversion: 2.1 time: 0.156923 Jun 29 11:24:53.286076 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 28/41] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:53 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1235 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:53.514284 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-38788154-7470-4a13-9992-1ce8b790038a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:53.517244 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-38788154-7470-4a13-9992-1ce8b790038a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:53.525290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38788154-7470-4a13-9992-1ce8b790038a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:53.526969 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38788154-7470-4a13-9992-1ce8b790038a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:53.527930 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38788154-7470-4a13-9992-1ce8b790038a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:53.534734 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38788154-7470-4a13-9992-1ce8b790038a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:53.626513 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-38788154-7470-4a13-9992-1ce8b790038a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:53.635163 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-38788154-7470-4a13-9992-1ce8b790038a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1274 microversion: 2.1 time: 0.125859 Jun 29 11:24:53.640713 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 14/42] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:53 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1274 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:53.672297 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-68ad4baa-9086-43ea-be82-8e4cc3a79dd0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:53.672733 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-68ad4baa-9086-43ea-be82-8e4cc3a79dd0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:53.684062 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68ad4baa-9086-43ea-be82-8e4cc3a79dd0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:53.684394 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68ad4baa-9086-43ea-be82-8e4cc3a79dd0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:53.685163 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68ad4baa-9086-43ea-be82-8e4cc3a79dd0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:53.686113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68ad4baa-9086-43ea-be82-8e4cc3a79dd0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:53.782137 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-68ad4baa-9086-43ea-be82-8e4cc3a79dd0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:53.794021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-68ad4baa-9086-43ea-be82-8e4cc3a79dd0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1265 microversion: 2.1 time: 0.124744 Jun 29 11:24:53.795221 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 29/43] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:53 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:53.822686 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-abeda51b-cc79-4290-b9cb-6c9218e739a3 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08a2f0af0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:53.875057 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-abeda51b-cc79-4290-b9cb-6c9218e739a3 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 200 len: 286 microversion: 2.1 time: 0.057133 Jun 29 11:24:53.878241 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 15/44] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:53 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:54.303663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-15d838c3-57d3-445a-aa96-b1de8c2458b5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:54.304940 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-15d838c3-57d3-445a-aa96-b1de8c2458b5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:54.653903 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3323ca00-4868-4d2f-bfd7-b7724f020361 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:54.654791 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3323ca00-4868-4d2f-bfd7-b7724f020361 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:54.662442 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3323ca00-4868-4d2f-bfd7-b7724f020361 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:54.666687 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3323ca00-4868-4d2f-bfd7-b7724f020361 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:54.667789 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3323ca00-4868-4d2f-bfd7-b7724f020361 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:54.671589 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-15d838c3-57d3-445a-aa96-b1de8c2458b5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:54.680108 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-15d838c3-57d3-445a-aa96-b1de8c2458b5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1235 microversion: 2.1 time: 0.380401 Jun 29 11:24:54.681196 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3323ca00-4868-4d2f-bfd7-b7724f020361 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:54.687251 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 30/45] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:54 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1235 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:54.816490 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-33e7d890-b455-40e6-a3ff-e27843427c12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:54.817224 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-33e7d890-b455-40e6-a3ff-e27843427c12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:54.830219 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33e7d890-b455-40e6-a3ff-e27843427c12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:54.836403 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33e7d890-b455-40e6-a3ff-e27843427c12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:54.844961 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33e7d890-b455-40e6-a3ff-e27843427c12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:54.849416 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33e7d890-b455-40e6-a3ff-e27843427c12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:54.926949 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3323ca00-4868-4d2f-bfd7-b7724f020361 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:54.943612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3323ca00-4868-4d2f-bfd7-b7724f020361 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1292 microversion: 2.1 time: 0.293555 Jun 29 11:24:54.951818 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 16/46] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:54 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1292 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:24:54.963987 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-72a5004f-f0df-46f5-8a82-3cdc9e32e875 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08a2f0dc0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:55.002466 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-33e7d890-b455-40e6-a3ff-e27843427c12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:55.044160 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-33e7d890-b455-40e6-a3ff-e27843427c12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1271 microversion: 2.1 time: 0.231093 Jun 29 11:24:55.056715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 31/47] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:54 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1271 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:55.460113 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-72a5004f-f0df-46f5-8a82-3cdc9e32e875 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] HTTP exception thrown: Snapshot e170e08c-a335-4856-805e-1a00db18c764 could not be found. Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-72a5004f-f0df-46f5-8a82-3cdc9e32e875 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Request method failure captured: Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 HTTP/1.1 Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDZxp92f7SHnw9UifRuc8ejijP1NAwLWT8IXxsC8xPtoBEiPoCZoCXcJYF620uEcilbzDb5kczRgjZ9vhYYLnYL8l2ZDgYrsS4coEOylRwVXqKEPimo3zRgQ1oxspFGa0kxiceYJ_o349A33ZObx-r7s7U5L18FQW5ck5XCoGaimRLU Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: bd0fad0a12a944dea5f22527241a6471 Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1125192404 Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:24:55.465043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd0fad0a12a944dea5f22527241a6471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd0fad0a12a944dea5f22527241a6471", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd0fad0a12a944dea5f22527241a6471"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd0fad0a12a944dea5f22527241a6471"}]}] Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1125192404 Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: bd0fad0a12a944dea5f22527241a6471 Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1125192404 Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesSnapshotsTestJSON-1125192404-project Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 5a8f922dfd1f464f9b50a83521c610f1 Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1125192404-project Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Snapshot e170e08c-a335-4856-805e-1a00db18c764 could not be found. Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': 'e170e08c-a335-4856-805e-1a00db18c764'} Jun 29 11:24:55.471088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e170e08c-a335-4856-805e-1a00db18c764 could not be found. (HTTP 404) (Request-ID: req-f50be9b3-cb9f-43c1-86d5-4ca48e92df43) Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:24:55.472044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 11:24:55.473171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e170e08c-a335-4856-805e-1a00db18c764 could not be found. Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 29 11:24:55.474478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e170e08c-a335-4856-805e-1a00db18c764 could not be found. Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e170e08c-a335-4856-805e-1a00db18c764 could not be found. Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-72a5004f-f0df-46f5-8a82-3cdc9e32e875 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Returning 404 to user: Snapshot e170e08c-a335-4856-805e-1a00db18c764 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:24:55.475712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-72a5004f-f0df-46f5-8a82-3cdc9e32e875 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764" status: 404 len: 111 microversion: 2.1 time: 0.513480 Jun 29 11:24:55.476663 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 17/48] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jun 29 11:24:54 2022] GET /compute/v2.1/os-snapshots/e170e08c-a335-4856-805e-1a00db18c764 => generated 111 bytes in 520 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:24:55.478276 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a726e3e0-2c3d-4832-afdd-df1e465704ae tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08aaf4ca0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:55.701742 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cf87af4c-3dda-43fa-8508-cc55b915959e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:55.702610 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cf87af4c-3dda-43fa-8508-cc55b915959e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:55.714467 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cf87af4c-3dda-43fa-8508-cc55b915959e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:55.715516 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cf87af4c-3dda-43fa-8508-cc55b915959e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:55.716439 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cf87af4c-3dda-43fa-8508-cc55b915959e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:55.717212 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cf87af4c-3dda-43fa-8508-cc55b915959e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:55.902951 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cf87af4c-3dda-43fa-8508-cc55b915959e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:55.902951 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cf87af4c-3dda-43fa-8508-cc55b915959e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1287 microversion: 2.1 time: 0.191158 Jun 29 11:24:55.902951 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 18/49] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:55 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1287 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:55.966485 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c2752cc4-6316-4493-9672-6af58aa43a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:55.968059 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c2752cc4-6316-4493-9672-6af58aa43a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:55.977238 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2752cc4-6316-4493-9672-6af58aa43a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:55.977871 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2752cc4-6316-4493-9672-6af58aa43a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:55.979059 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2752cc4-6316-4493-9672-6af58aa43a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:55.979765 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2752cc4-6316-4493-9672-6af58aa43a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:56.194738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c2752cc4-6316-4493-9672-6af58aa43a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:56.221259 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c2752cc4-6316-4493-9672-6af58aa43a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1280 microversion: 2.1 time: 0.261228 Jun 29 11:24:56.222624 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 19/50] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:55 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1280 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:24:56.238263 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e6366187-c352-4321-98d7-8744594af434 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:56.238834 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e6366187-c352-4321-98d7-8744594af434 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:56.257009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6366187-c352-4321-98d7-8744594af434 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:56.258659 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6366187-c352-4321-98d7-8744594af434 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:56.275288 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6366187-c352-4321-98d7-8744594af434 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:56.275288 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6366187-c352-4321-98d7-8744594af434 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:56.528171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a726e3e0-2c3d-4832-afdd-df1e465704ae tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 202 len: 0 microversion: 2.1 time: 1.049122 Jun 29 11:24:56.528171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 32/51] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jun 29 11:24:55 2022] DELETE /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:24:56.543482 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6b483d9a-de90-44b1-81ee-013a059c5021 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08aa91af0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:56.955613 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6b483d9a-de90-44b1-81ee-013a059c5021 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 200 len: 345 microversion: 2.1 time: 0.421735 Jun 29 11:24:56.956854 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 33/52] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:24:56 2022] GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 345 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:56.963412 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-70a8e131-9ab3-4bfd-9ddc-550e0bf7d9da tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:56.964513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-70a8e131-9ab3-4bfd-9ddc-550e0bf7d9da tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:56.982138 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70a8e131-9ab3-4bfd-9ddc-550e0bf7d9da tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:56.983489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70a8e131-9ab3-4bfd-9ddc-550e0bf7d9da tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:56.986616 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70a8e131-9ab3-4bfd-9ddc-550e0bf7d9da tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:56.988371 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70a8e131-9ab3-4bfd-9ddc-550e0bf7d9da tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:57.059324 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e6366187-c352-4321-98d7-8744594af434 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:57.069297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e6366187-c352-4321-98d7-8744594af434 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.844371 Jun 29 11:24:57.071087 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 20/53] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:56 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:57.138743 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-70a8e131-9ab3-4bfd-9ddc-550e0bf7d9da tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:57.147968 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-70a8e131-9ab3-4bfd-9ddc-550e0bf7d9da tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1295 microversion: 2.1 time: 0.189837 Jun 29 11:24:57.148789 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 34/54] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:56 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1295 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:57.238937 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-48781895-95ff-4624-bedc-10592a0cfd7f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:57.239474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-48781895-95ff-4624-bedc-10592a0cfd7f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:57.246326 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-48781895-95ff-4624-bedc-10592a0cfd7f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:57.247412 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-48781895-95ff-4624-bedc-10592a0cfd7f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:57.248595 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-48781895-95ff-4624-bedc-10592a0cfd7f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:57.249206 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-48781895-95ff-4624-bedc-10592a0cfd7f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:57.335686 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-48781895-95ff-4624-bedc-10592a0cfd7f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:57.345061 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-48781895-95ff-4624-bedc-10592a0cfd7f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1280 microversion: 2.1 time: 0.110070 Jun 29 11:24:57.345645 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 21/55] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:57 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1280 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:57.970290 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ca0066ae-c0c3-432d-afb4-0a98eb9c2d79 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08aaa6dc0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:58.087642 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5b4d5e91-14a0-414c-9e73-530add8f65d3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:58.089450 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5b4d5e91-14a0-414c-9e73-530add8f65d3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:58.105247 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b4d5e91-14a0-414c-9e73-530add8f65d3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:58.105247 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b4d5e91-14a0-414c-9e73-530add8f65d3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:58.105247 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b4d5e91-14a0-414c-9e73-530add8f65d3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:58.105691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b4d5e91-14a0-414c-9e73-530add8f65d3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:58.282275 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5b4d5e91-14a0-414c-9e73-530add8f65d3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:58.295620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5b4d5e91-14a0-414c-9e73-530add8f65d3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.212856 Jun 29 11:24:58.296248 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 22/56] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:58 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:58.301091 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1bbc3cd8-fab2-4cc8-b34d-550be1f8f763 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:58.301699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1bbc3cd8-fab2-4cc8-b34d-550be1f8f763 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:58.308660 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1bbc3cd8-fab2-4cc8-b34d-550be1f8f763 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:58.309113 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1bbc3cd8-fab2-4cc8-b34d-550be1f8f763 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:58.309885 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1bbc3cd8-fab2-4cc8-b34d-550be1f8f763 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:58.310338 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1bbc3cd8-fab2-4cc8-b34d-550be1f8f763 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:58.336404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ca0066ae-c0c3-432d-afb4-0a98eb9c2d79 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 200 len: 345 microversion: 2.1 time: 0.370273 Jun 29 11:24:58.342513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 35/57] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:24:57 2022] GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 345 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:24:58.362215 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26220af3-0abf-4b72-ad57-2013faf233da tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:58.362833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-26220af3-0abf-4b72-ad57-2013faf233da tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:58.369941 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26220af3-0abf-4b72-ad57-2013faf233da tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:58.370687 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26220af3-0abf-4b72-ad57-2013faf233da tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:58.371474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26220af3-0abf-4b72-ad57-2013faf233da tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:58.371934 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26220af3-0abf-4b72-ad57-2013faf233da tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:58.377524 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1bbc3cd8-fab2-4cc8-b34d-550be1f8f763 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:58.386132 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1bbc3cd8-fab2-4cc8-b34d-550be1f8f763 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1295 microversion: 2.1 time: 0.088525 Jun 29 11:24:58.387161 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 23/58] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:58 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:58.510251 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-26220af3-0abf-4b72-ad57-2013faf233da tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:58.517513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-26220af3-0abf-4b72-ad57-2013faf233da tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.159082 Jun 29 11:24:58.518069 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 36/59] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:58 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:24:59.313471 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2a5d82ed-bd54-4dce-85ca-9d054406786d tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:59.314316 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2a5d82ed-bd54-4dce-85ca-9d054406786d tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:59.321230 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2a5d82ed-bd54-4dce-85ca-9d054406786d tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:59.321898 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2a5d82ed-bd54-4dce-85ca-9d054406786d tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:59.322816 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2a5d82ed-bd54-4dce-85ca-9d054406786d tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:59.323417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2a5d82ed-bd54-4dce-85ca-9d054406786d tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:59.351167 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7b400050-b562-4714-bff5-2b343297b3c2 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08aaa6940>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:59.447032 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7b400050-b562-4714-bff5-2b343297b3c2 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 200 len: 345 microversion: 2.1 time: 0.101565 Jun 29 11:24:59.448059 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 37/60] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:24:59 2022] GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:24:59.453149 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a7bfdb69-b88c-4189-9445-cea82c9d6dc0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:59.454485 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a7bfdb69-b88c-4189-9445-cea82c9d6dc0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:59.461126 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7bfdb69-b88c-4189-9445-cea82c9d6dc0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:59.462030 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7bfdb69-b88c-4189-9445-cea82c9d6dc0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:59.463401 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7bfdb69-b88c-4189-9445-cea82c9d6dc0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:59.464309 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7bfdb69-b88c-4189-9445-cea82c9d6dc0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:59.543462 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2a5d82ed-bd54-4dce-85ca-9d054406786d tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:59.552555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2a5d82ed-bd54-4dce-85ca-9d054406786d tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.243050 Jun 29 11:24:59.556345 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 24/61] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:59 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:59.561976 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-be711471-ea38-4b05-85af-da42d0ae23d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:24:59.562154 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-be711471-ea38-4b05-85af-da42d0ae23d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:24:59.567302 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a7bfdb69-b88c-4189-9445-cea82c9d6dc0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:59.574925 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be711471-ea38-4b05-85af-da42d0ae23d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:59.575376 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be711471-ea38-4b05-85af-da42d0ae23d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:59.576189 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be711471-ea38-4b05-85af-da42d0ae23d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:24:59.576524 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a7bfdb69-b88c-4189-9445-cea82c9d6dc0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1295 microversion: 2.1 time: 0.127109 Jun 29 11:24:59.576637 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be711471-ea38-4b05-85af-da42d0ae23d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:24:59.577587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 38/62] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:59 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:24:59.732915 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-be711471-ea38-4b05-85af-da42d0ae23d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:24:59.741298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-be711471-ea38-4b05-85af-da42d0ae23d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.183826 Jun 29 11:24:59.743043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 25/63] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:24:59 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:00.459609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-04187d0b-d9ee-47ac-9c7f-5ad766d0555c tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08aaa64c0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:00.511798 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-04187d0b-d9ee-47ac-9c7f-5ad766d0555c tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 200 len: 345 microversion: 2.1 time: 0.055825 Jun 29 11:25:00.512544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 39/64] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:25:00 2022] GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:00.575116 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-727987ba-dfd7-457a-811f-82c7f9d283fa tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:00.576360 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-727987ba-dfd7-457a-811f-82c7f9d283fa tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:00.583015 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-727987ba-dfd7-457a-811f-82c7f9d283fa tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:00.583595 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-727987ba-dfd7-457a-811f-82c7f9d283fa tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:00.584559 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-727987ba-dfd7-457a-811f-82c7f9d283fa tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:00.585210 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-727987ba-dfd7-457a-811f-82c7f9d283fa tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:00.594845 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-843d2b42-4ef2-411a-a879-76a45a302f74 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:00.595594 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-843d2b42-4ef2-411a-a879-76a45a302f74 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:00.603435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-843d2b42-4ef2-411a-a879-76a45a302f74 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:00.607394 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-843d2b42-4ef2-411a-a879-76a45a302f74 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:00.607896 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-843d2b42-4ef2-411a-a879-76a45a302f74 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:00.608434 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-843d2b42-4ef2-411a-a879-76a45a302f74 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:00.693738 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-843d2b42-4ef2-411a-a879-76a45a302f74 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:00.701679 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-843d2b42-4ef2-411a-a879-76a45a302f74 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1295 microversion: 2.1 time: 0.111076 Jun 29 11:25:00.702239 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 40/65] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:00 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1295 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:00.755411 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-727987ba-dfd7-457a-811f-82c7f9d283fa tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:00.761344 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9d5234d4-4353-4dcf-9b0b-b555a9f7da2f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:00.762185 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9d5234d4-4353-4dcf-9b0b-b555a9f7da2f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:00.764876 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-727987ba-dfd7-457a-811f-82c7f9d283fa tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.195100 Jun 29 11:25:00.765946 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 26/66] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:00 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:00.771291 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d5234d4-4353-4dcf-9b0b-b555a9f7da2f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:00.771912 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d5234d4-4353-4dcf-9b0b-b555a9f7da2f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:00.772730 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d5234d4-4353-4dcf-9b0b-b555a9f7da2f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:00.773467 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d5234d4-4353-4dcf-9b0b-b555a9f7da2f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:00.905976 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9d5234d4-4353-4dcf-9b0b-b555a9f7da2f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:00.913924 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9d5234d4-4353-4dcf-9b0b-b555a9f7da2f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.156893 Jun 29 11:25:00.916379 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 41/67] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:00 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:01.525394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-50be893d-119c-4cc0-bc24-a16adba1acbb tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08a2f0dc0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:01.588079 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-50be893d-119c-4cc0-bc24-a16adba1acbb tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 200 len: 345 microversion: 2.1 time: 0.067242 Jun 29 11:25:01.588720 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 27/68] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:25:01 2022] GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:25:01.718502 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d8b4ec33-0515-4005-b927-88531506c85a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:01.719469 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d8b4ec33-0515-4005-b927-88531506c85a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:01.725739 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8b4ec33-0515-4005-b927-88531506c85a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:01.726786 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8b4ec33-0515-4005-b927-88531506c85a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:01.727617 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8b4ec33-0515-4005-b927-88531506c85a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:01.728619 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8b4ec33-0515-4005-b927-88531506c85a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:01.782873 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0820408e-acbd-4787-847f-390da6c161a1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:01.783553 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0820408e-acbd-4787-847f-390da6c161a1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:01.786604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:01.791165 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0820408e-acbd-4787-847f-390da6c161a1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:01.791465 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0820408e-acbd-4787-847f-390da6c161a1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:01.792370 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0820408e-acbd-4787-847f-390da6c161a1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:01.792852 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0820408e-acbd-4787-847f-390da6c161a1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:01.793205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d8b4ec33-0515-4005-b927-88531506c85a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:01.800644 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d8b4ec33-0515-4005-b927-88531506c85a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1295 microversion: 2.1 time: 0.085923 Jun 29 11:25:01.801209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 42/69] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:01 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:01.919448 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0820408e-acbd-4787-847f-390da6c161a1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:01.927309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0820408e-acbd-4787-847f-390da6c161a1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.148527 Jun 29 11:25:01.927887 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 28/70] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:01 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:01.930594 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ccaa99ce-9ce3-46b9-a667-cd6ccc4ecc06 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:01.931341 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ccaa99ce-9ce3-46b9-a667-cd6ccc4ecc06 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:01.937501 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ccaa99ce-9ce3-46b9-a667-cd6ccc4ecc06 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:01.937954 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ccaa99ce-9ce3-46b9-a667-cd6ccc4ecc06 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:01.938718 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ccaa99ce-9ce3-46b9-a667-cd6ccc4ecc06 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:01.939156 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ccaa99ce-9ce3-46b9-a667-cd6ccc4ecc06 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:02.182176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ccaa99ce-9ce3-46b9-a667-cd6ccc4ecc06 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:02.190902 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ccaa99ce-9ce3-46b9-a667-cd6ccc4ecc06 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.264297 Jun 29 11:25:02.191670 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 43/71] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:01 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:02.642637 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3a7988a0-4c3d-4415-8a4c-d40a7114c404 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08a3a0e50>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:02.647573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3a7988a0-4c3d-4415-8a4c-d40a7114c404 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 200 len: 345 microversion: 2.1 time: 0.050579 Jun 29 11:25:02.648195 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 29/72] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:25:02 2022] GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:02.816697 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11b5945f-c80b-40d8-b2d9-d0b5c37e56c0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:02.817303 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-11b5945f-c80b-40d8-b2d9-d0b5c37e56c0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:02.823204 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11b5945f-c80b-40d8-b2d9-d0b5c37e56c0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:02.823775 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11b5945f-c80b-40d8-b2d9-d0b5c37e56c0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:02.824548 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11b5945f-c80b-40d8-b2d9-d0b5c37e56c0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:02.824976 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11b5945f-c80b-40d8-b2d9-d0b5c37e56c0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:02.884547 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-11b5945f-c80b-40d8-b2d9-d0b5c37e56c0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:02.891657 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-11b5945f-c80b-40d8-b2d9-d0b5c37e56c0 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1295 microversion: 2.1 time: 0.078845 Jun 29 11:25:02.892322 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 44/73] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:02 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1295 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:02.940736 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=8 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:02.944695 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4aa8dc39-e2c4-49fd-a4b4-31697e1666a8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:02.945306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4aa8dc39-e2c4-49fd-a4b4-31697e1666a8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:02.951042 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4aa8dc39-e2c4-49fd-a4b4-31697e1666a8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:02.951476 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4aa8dc39-e2c4-49fd-a4b4-31697e1666a8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:02.954344 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4aa8dc39-e2c4-49fd-a4b4-31697e1666a8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:02.954344 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4aa8dc39-e2c4-49fd-a4b4-31697e1666a8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:02.954344 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=28 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:03.104410 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4aa8dc39-e2c4-49fd-a4b4-31697e1666a8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:03.111765 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4aa8dc39-e2c4-49fd-a4b4-31697e1666a8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.171767 Jun 29 11:25:03.112352 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 30/74] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:02 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:03.209019 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f1670c08-19a2-46e2-a9b3-dd8047a7465e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:03.209907 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f1670c08-19a2-46e2-a9b3-dd8047a7465e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:03.217274 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1670c08-19a2-46e2-a9b3-dd8047a7465e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:03.217724 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1670c08-19a2-46e2-a9b3-dd8047a7465e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:03.218503 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1670c08-19a2-46e2-a9b3-dd8047a7465e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:03.219203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1670c08-19a2-46e2-a9b3-dd8047a7465e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:03.355674 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f1670c08-19a2-46e2-a9b3-dd8047a7465e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:03.363370 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f1670c08-19a2-46e2-a9b3-dd8047a7465e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.158143 Jun 29 11:25:03.370226 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 45/75] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:03 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:03.659528 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0646458c-e6ca-4176-b507-83c14d2821d9 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08a2f0700>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:03.706294 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0646458c-e6ca-4176-b507-83c14d2821d9 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 200 len: 345 microversion: 2.1 time: 0.050458 Jun 29 11:25:03.706868 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 31/76] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:25:03 2022] GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:03.907477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bfee10a8-8793-425c-a670-27390f8fdc1b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:03.908358 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bfee10a8-8793-425c-a670-27390f8fdc1b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:03.918435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfee10a8-8793-425c-a670-27390f8fdc1b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:03.918751 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfee10a8-8793-425c-a670-27390f8fdc1b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:03.919650 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfee10a8-8793-425c-a670-27390f8fdc1b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:03.920110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfee10a8-8793-425c-a670-27390f8fdc1b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:03.989962 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bfee10a8-8793-425c-a670-27390f8fdc1b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:03.998110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bfee10a8-8793-425c-a670-27390f8fdc1b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1295 microversion: 2.1 time: 0.094339 Jun 29 11:25:03.998767 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 46/77] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:03 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1295 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:04.129301 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2d7a4258-d87f-474a-8ed4-21674ad462b1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:04.129912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2d7a4258-d87f-474a-8ed4-21674ad462b1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:04.139765 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d7a4258-d87f-474a-8ed4-21674ad462b1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:04.140363 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d7a4258-d87f-474a-8ed4-21674ad462b1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:04.141194 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d7a4258-d87f-474a-8ed4-21674ad462b1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:04.141877 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2d7a4258-d87f-474a-8ed4-21674ad462b1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:04.296892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2d7a4258-d87f-474a-8ed4-21674ad462b1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:04.306265 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2d7a4258-d87f-474a-8ed4-21674ad462b1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.180727 Jun 29 11:25:04.308409 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 32/78] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:04 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:04.381815 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7eda5faf-be10-4694-9395-e700cfa33c07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:04.382432 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7eda5faf-be10-4694-9395-e700cfa33c07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:04.393553 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7eda5faf-be10-4694-9395-e700cfa33c07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:04.393553 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7eda5faf-be10-4694-9395-e700cfa33c07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:04.393553 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7eda5faf-be10-4694-9395-e700cfa33c07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:04.393553 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7eda5faf-be10-4694-9395-e700cfa33c07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:04.550251 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7eda5faf-be10-4694-9395-e700cfa33c07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:04.550251 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7eda5faf-be10-4694-9395-e700cfa33c07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.172006 Jun 29 11:25:04.550251 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 47/79] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:04 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:04.727981 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c8f0e367-b006-435c-91db-05965fe04c9d tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08a2f0ca0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:04.779225 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-c8f0e367-b006-435c-91db-05965fe04c9d tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] HTTP exception thrown: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c8f0e367-b006-435c-91db-05965fe04c9d tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Request method failure captured: Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e HTTP/1.1 Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDZxp92f7SHnw9UifRuc8ejijP1NAwLWT8IXxsC8xPtoBEiPoCZoCXcJYF620uEcilbzDb5kczRgjZ9vhYYLnYL8l2ZDgYrsS4coEOylRwVXqKEPimo3zRgQ1oxspFGa0kxiceYJ_o349A33ZObx-r7s7U5L18FQW5ck5XCoGaimRLU Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: bd0fad0a12a944dea5f22527241a6471 Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1125192404 Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:25:04.781815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd0fad0a12a944dea5f22527241a6471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd0fad0a12a944dea5f22527241a6471", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd0fad0a12a944dea5f22527241a6471"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd0fad0a12a944dea5f22527241a6471"}]}] Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1125192404 Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: bd0fad0a12a944dea5f22527241a6471 Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1125192404 Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesSnapshotsTestJSON-1125192404-project Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 5a8f922dfd1f464f9b50a83521c610f1 Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1125192404-project Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': 'c24dba68-8b96-42da-88d3-6bd581ed4b7e'} Jun 29 11:25:04.783023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. (HTTP 404) (Request-ID: req-02b993f5-78d3-4a4b-b1f7-c49712821063) Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:25:04.783692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 11:25:04.784703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 11:25:04.785628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c8f0e367-b006-435c-91db-05965fe04c9d tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Returning 404 to user: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:25:04.786555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c8f0e367-b006-435c-91db-05965fe04c9d tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 404 len: 109 microversion: 2.1 time: 0.065283 Jun 29 11:25:04.916378 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 33/80] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:25:04 2022] GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eb6426ab-12f6-468a-abd8-b917352aca26 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08aad64c0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=14 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-eb6426ab-12f6-468a-abd8-b917352aca26 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] HTTP exception thrown: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eb6426ab-12f6-468a-abd8-b917352aca26 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Request method failure captured: Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e HTTP/1.1 Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZxp92f7SHnw9UifRuc8ejijP1NAwLWT8IXxsC8xPtoBEiPoCZoCXcJYF620uEcilbzDb5kczRgjZ9vhYYLnYL8l2ZDgYrsS4coEOylRwVXqKEPimo3zRgQ1oxspFGa0kxiceYJ_o349A33ZObx-r7s7U5L18FQW5ck5XCoGaimRLU Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: bd0fad0a12a944dea5f22527241a6471 Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1125192404 Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:25:04.916806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd0fad0a12a944dea5f22527241a6471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd0fad0a12a944dea5f22527241a6471", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd0fad0a12a944dea5f22527241a6471"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd0fad0a12a944dea5f22527241a6471"}]}] Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1125192404 Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: bd0fad0a12a944dea5f22527241a6471 Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1125192404 Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotsTestJSON-1125192404-project Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 5a8f922dfd1f464f9b50a83521c610f1 Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1125192404-project Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': 'c24dba68-8b96-42da-88d3-6bd581ed4b7e'} Jun 29 11:25:04.918930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. (HTTP 404) (Request-ID: req-ac6700c0-cf6f-43a7-80d4-d9b050260a97) Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:25:04.948895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 11:25:04.950074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 11:25:04.951157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eb6426ab-12f6-468a-abd8-b917352aca26 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Returning 404 to user: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eb6426ab-12f6-468a-abd8-b917352aca26 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 404 len: 109 microversion: 2.1 time: 0.055427 Jun 29 11:25:04.952200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 48/81] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jun 29 11:25:04 2022] DELETE /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:25:04.952990 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1a9aadc4-fcc3-4af2-82bd-ef2ad5ea1fb4 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Calling method '.version_select at 0x7fd08a2863a0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:05.022500 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-17fbabd9-b7b1-48a0-bf87-98915d248f56 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:05.023698 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-17fbabd9-b7b1-48a0-bf87-98915d248f56 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:05.037366 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17fbabd9-b7b1-48a0-bf87-98915d248f56 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:05.037366 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17fbabd9-b7b1-48a0-bf87-98915d248f56 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:05.037366 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17fbabd9-b7b1-48a0-bf87-98915d248f56 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:05.037366 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17fbabd9-b7b1-48a0-bf87-98915d248f56 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:05.112596 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-17fbabd9-b7b1-48a0-bf87-98915d248f56 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:05.120226 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-17fbabd9-b7b1-48a0-bf87-98915d248f56 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1295 microversion: 2.1 time: 0.101578 Jun 29 11:25:05.120855 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 49/82] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:05 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1295 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:05.163415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-1a9aadc4-fcc3-4af2-82bd-ef2ad5ea1fb4 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] HTTP exception thrown: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1a9aadc4-fcc3-4af2-82bd-ef2ad5ea1fb4 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Request method failure captured: Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e HTTP/1.1 Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDZxp92f7SHnw9UifRuc8ejijP1NAwLWT8IXxsC8xPtoBEiPoCZoCXcJYF620uEcilbzDb5kczRgjZ9vhYYLnYL8l2ZDgYrsS4coEOylRwVXqKEPimo3zRgQ1oxspFGa0kxiceYJ_o349A33ZObx-r7s7U5L18FQW5ck5XCoGaimRLU Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: bd0fad0a12a944dea5f22527241a6471 Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1125192404 Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:25:05.165865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd0fad0a12a944dea5f22527241a6471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd0fad0a12a944dea5f22527241a6471", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd0fad0a12a944dea5f22527241a6471"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd0fad0a12a944dea5f22527241a6471"}]}] Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1125192404 Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: bd0fad0a12a944dea5f22527241a6471 Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1125192404 Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesSnapshotsTestJSON-1125192404-project Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 5a8f922dfd1f464f9b50a83521c610f1 Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1125192404-project Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': 'c24dba68-8b96-42da-88d3-6bd581ed4b7e'} Jun 29 11:25:05.166992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. (HTTP 404) (Request-ID: req-8b568b05-f669-493c-abcc-4c0c3ce58b25) Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:25:05.167807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 11:25:05.168737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 11:25:05.169612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1a9aadc4-fcc3-4af2-82bd-ef2ad5ea1fb4 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] Returning 404 to user: Volume c24dba68-8b96-42da-88d3-6bd581ed4b7e could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:25:05.170504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1a9aadc4-fcc3-4af2-82bd-ef2ad5ea1fb4 tempest-VolumesSnapshotsTestJSON-1125192404 tempest-VolumesSnapshotsTestJSON-1125192404-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e" status: 404 len: 109 microversion: 2.1 time: 0.304270 Jun 29 11:25:05.171396 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 34/83] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:25:04 2022] GET /compute/v2.1/os-volumes/c24dba68-8b96-42da-88d3-6bd581ed4b7e => generated 109 bytes in 306 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 11:25:05.325729 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f64aec3b-62d5-4273-965c-33831b870099 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:05.326400 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f64aec3b-62d5-4273-965c-33831b870099 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:05.332331 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f64aec3b-62d5-4273-965c-33831b870099 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:05.332750 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f64aec3b-62d5-4273-965c-33831b870099 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:05.333889 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f64aec3b-62d5-4273-965c-33831b870099 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:05.334356 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f64aec3b-62d5-4273-965c-33831b870099 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:05.352950 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:05.506609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f64aec3b-62d5-4273-965c-33831b870099 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:05.514576 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f64aec3b-62d5-4273-965c-33831b870099 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.193788 Jun 29 11:25:05.515184 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 50/84] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:05 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:05.569280 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-431f0dc4-1a12-4188-b592-dbabacad38c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:05.570491 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-431f0dc4-1a12-4188-b592-dbabacad38c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:05.577625 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-431f0dc4-1a12-4188-b592-dbabacad38c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:05.578173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-431f0dc4-1a12-4188-b592-dbabacad38c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:05.579023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-431f0dc4-1a12-4188-b592-dbabacad38c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:05.579736 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-431f0dc4-1a12-4188-b592-dbabacad38c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:05.584661 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:05.798462 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-431f0dc4-1a12-4188-b592-dbabacad38c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:05.806843 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-431f0dc4-1a12-4188-b592-dbabacad38c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.241549 Jun 29 11:25:05.807405 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 35/85] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:05 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:06.137715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-70283e9b-68a0-4b1a-92d0-9fad3a55a5ac tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:06.138340 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-70283e9b-68a0-4b1a-92d0-9fad3a55a5ac tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:06.152347 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70283e9b-68a0-4b1a-92d0-9fad3a55a5ac tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:06.152347 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70283e9b-68a0-4b1a-92d0-9fad3a55a5ac tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:06.152347 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70283e9b-68a0-4b1a-92d0-9fad3a55a5ac tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:06.152347 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70283e9b-68a0-4b1a-92d0-9fad3a55a5ac tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:06.285748 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-70283e9b-68a0-4b1a-92d0-9fad3a55a5ac tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:06.298259 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-70283e9b-68a0-4b1a-92d0-9fad3a55a5ac tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1295 microversion: 2.1 time: 0.165009 Jun 29 11:25:06.301883 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 51/86] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:06 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1295 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:06.531800 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7059d719-5ed6-42ce-9d68-e1487d612090 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:06.532442 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7059d719-5ed6-42ce-9d68-e1487d612090 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:06.539315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7059d719-5ed6-42ce-9d68-e1487d612090 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:06.540598 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7059d719-5ed6-42ce-9d68-e1487d612090 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:06.540598 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7059d719-5ed6-42ce-9d68-e1487d612090 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:06.541012 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7059d719-5ed6-42ce-9d68-e1487d612090 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:06.758078 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7059d719-5ed6-42ce-9d68-e1487d612090 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:06.766602 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7059d719-5ed6-42ce-9d68-e1487d612090 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.238587 Jun 29 11:25:06.767425 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 36/87] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:06 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:06.824809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0ff31574-d581-4d64-9b26-75c6299d0e07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:06.825986 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0ff31574-d581-4d64-9b26-75c6299d0e07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:06.834089 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ff31574-d581-4d64-9b26-75c6299d0e07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:06.834792 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ff31574-d581-4d64-9b26-75c6299d0e07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:06.835609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ff31574-d581-4d64-9b26-75c6299d0e07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:06.836089 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ff31574-d581-4d64-9b26-75c6299d0e07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:07.063344 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0ff31574-d581-4d64-9b26-75c6299d0e07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:07.063344 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0ff31574-d581-4d64-9b26-75c6299d0e07 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.203298 Jun 29 11:25:07.063344 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 52/88] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:06 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:07.319106 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-09922172-ee64-46aa-a78a-03266f45b289 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:07.319774 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-09922172-ee64-46aa-a78a-03266f45b289 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:07.330951 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09922172-ee64-46aa-a78a-03266f45b289 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:07.336288 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09922172-ee64-46aa-a78a-03266f45b289 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:07.336288 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09922172-ee64-46aa-a78a-03266f45b289 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:07.336288 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09922172-ee64-46aa-a78a-03266f45b289 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:07.449174 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-09922172-ee64-46aa-a78a-03266f45b289 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:07.461134 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-09922172-ee64-46aa-a78a-03266f45b289 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1295 microversion: 2.1 time: 0.147946 Jun 29 11:25:07.470713 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 37/89] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:07 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1295 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:07.785032 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1555d399-56b9-45bc-9e18-29c4667fae91 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:07.785623 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1555d399-56b9-45bc-9e18-29c4667fae91 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:07.792436 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1555d399-56b9-45bc-9e18-29c4667fae91 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:07.792897 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1555d399-56b9-45bc-9e18-29c4667fae91 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:07.793662 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1555d399-56b9-45bc-9e18-29c4667fae91 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:07.794127 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1555d399-56b9-45bc-9e18-29c4667fae91 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:07.929882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1555d399-56b9-45bc-9e18-29c4667fae91 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:07.937213 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1555d399-56b9-45bc-9e18-29c4667fae91 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.156395 Jun 29 11:25:07.937770 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 53/90] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:07 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:08.079538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-596a3e14-4a11-4c5c-828b-445157b41fdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:08.080375 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-596a3e14-4a11-4c5c-828b-445157b41fdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:08.086773 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-596a3e14-4a11-4c5c-828b-445157b41fdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:08.087217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-596a3e14-4a11-4c5c-828b-445157b41fdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:08.088176 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-596a3e14-4a11-4c5c-828b-445157b41fdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:08.088610 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-596a3e14-4a11-4c5c-828b-445157b41fdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:08.220114 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-596a3e14-4a11-4c5c-828b-445157b41fdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:08.228005 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-596a3e14-4a11-4c5c-828b-445157b41fdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.152223 Jun 29 11:25:08.228566 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 38/91] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:08 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:08.477676 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e62945dd-1d3a-4771-b62a-3c2b8cad2764 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:08.478264 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e62945dd-1d3a-4771-b62a-3c2b8cad2764 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:08.490443 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e62945dd-1d3a-4771-b62a-3c2b8cad2764 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:08.492294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e62945dd-1d3a-4771-b62a-3c2b8cad2764 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:08.497350 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e62945dd-1d3a-4771-b62a-3c2b8cad2764 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:08.498870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e62945dd-1d3a-4771-b62a-3c2b8cad2764 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:08.574495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e62945dd-1d3a-4771-b62a-3c2b8cad2764 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:08.582421 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e62945dd-1d3a-4771-b62a-3c2b8cad2764 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1295 microversion: 2.1 time: 0.108929 Jun 29 11:25:08.582980 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 54/92] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:08 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1295 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:08.955328 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-25786193-f78a-424f-9df3-f7bca89509cb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:08.956021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-25786193-f78a-424f-9df3-f7bca89509cb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:08.962395 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25786193-f78a-424f-9df3-f7bca89509cb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:08.962834 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25786193-f78a-424f-9df3-f7bca89509cb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:08.963579 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25786193-f78a-424f-9df3-f7bca89509cb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:08.964036 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25786193-f78a-424f-9df3-f7bca89509cb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:09.103137 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-25786193-f78a-424f-9df3-f7bca89509cb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:09.111188 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-25786193-f78a-424f-9df3-f7bca89509cb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.160199 Jun 29 11:25:09.111679 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 39/93] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:08 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:09.245607 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-afe65a7f-9b7b-48a6-bc73-cfef1121f2d7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:09.246470 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-afe65a7f-9b7b-48a6-bc73-cfef1121f2d7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:09.253888 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afe65a7f-9b7b-48a6-bc73-cfef1121f2d7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:09.254440 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afe65a7f-9b7b-48a6-bc73-cfef1121f2d7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:09.255581 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afe65a7f-9b7b-48a6-bc73-cfef1121f2d7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:09.256266 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afe65a7f-9b7b-48a6-bc73-cfef1121f2d7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:09.434792 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-afe65a7f-9b7b-48a6-bc73-cfef1121f2d7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:09.443520 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-afe65a7f-9b7b-48a6-bc73-cfef1121f2d7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.202377 Jun 29 11:25:09.445300 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 55/94] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:09 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:09.619299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b04ebbd5-9879-4f9f-8302-65513589d704 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:09.619299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b04ebbd5-9879-4f9f-8302-65513589d704 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:09.626223 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b04ebbd5-9879-4f9f-8302-65513589d704 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:09.629163 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b04ebbd5-9879-4f9f-8302-65513589d704 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:09.631783 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b04ebbd5-9879-4f9f-8302-65513589d704 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:09.633101 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b04ebbd5-9879-4f9f-8302-65513589d704 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:09.767090 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b04ebbd5-9879-4f9f-8302-65513589d704 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:09.776678 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b04ebbd5-9879-4f9f-8302-65513589d704 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1305 microversion: 2.1 time: 0.170168 Jun 29 11:25:09.777264 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 40/95] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:09 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1305 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:10.128373 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fbee719e-6169-4401-b2c8-53204d3733b3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:10.128988 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fbee719e-6169-4401-b2c8-53204d3733b3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:10.138372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbee719e-6169-4401-b2c8-53204d3733b3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:10.139876 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbee719e-6169-4401-b2c8-53204d3733b3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:10.141592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbee719e-6169-4401-b2c8-53204d3733b3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:10.145400 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbee719e-6169-4401-b2c8-53204d3733b3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:10.461527 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f3a6e783-01cb-4b94-bebd-1ad43c9788fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:10.462127 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f3a6e783-01cb-4b94-bebd-1ad43c9788fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:10.472401 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3a6e783-01cb-4b94-bebd-1ad43c9788fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:10.474952 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3a6e783-01cb-4b94-bebd-1ad43c9788fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:10.482069 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3a6e783-01cb-4b94-bebd-1ad43c9788fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:10.482964 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3a6e783-01cb-4b94-bebd-1ad43c9788fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:10.720832 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fbee719e-6169-4401-b2c8-53204d3733b3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:10.756639 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fbee719e-6169-4401-b2c8-53204d3733b3 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.632368 Jun 29 11:25:10.766125 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 56/96] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:10 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:10.802580 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-236e2255-facb-48d9-88e0-5ea4cef23a4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:10.803268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-236e2255-facb-48d9-88e0-5ea4cef23a4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:10.824814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-236e2255-facb-48d9-88e0-5ea4cef23a4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:10.824814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-236e2255-facb-48d9-88e0-5ea4cef23a4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:10.824814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-236e2255-facb-48d9-88e0-5ea4cef23a4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:10.824814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-236e2255-facb-48d9-88e0-5ea4cef23a4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:10.957589 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f3a6e783-01cb-4b94-bebd-1ad43c9788fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:10.970067 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f3a6e783-01cb-4b94-bebd-1ad43c9788fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.512892 Jun 29 11:25:10.970677 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 41/97] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:10 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:11.218172 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-236e2255-facb-48d9-88e0-5ea4cef23a4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:11.230653 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-236e2255-facb-48d9-88e0-5ea4cef23a4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.441664 Jun 29 11:25:11.233093 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 57/98] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:10 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:11.781284 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-66f97cb0-1b0f-47d4-aa54-146e17bf7add tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:11.782574 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-66f97cb0-1b0f-47d4-aa54-146e17bf7add tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:11.797360 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-66f97cb0-1b0f-47d4-aa54-146e17bf7add tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:11.799261 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-66f97cb0-1b0f-47d4-aa54-146e17bf7add tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:11.804239 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-66f97cb0-1b0f-47d4-aa54-146e17bf7add tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:11.807882 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-66f97cb0-1b0f-47d4-aa54-146e17bf7add tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:11.987274 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d97dcbda-897b-45eb-9632-72ffa5f891f5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:11.992299 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d97dcbda-897b-45eb-9632-72ffa5f891f5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:12.001688 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d97dcbda-897b-45eb-9632-72ffa5f891f5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:12.002138 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d97dcbda-897b-45eb-9632-72ffa5f891f5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:12.002908 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d97dcbda-897b-45eb-9632-72ffa5f891f5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:12.003360 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d97dcbda-897b-45eb-9632-72ffa5f891f5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:12.450531 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-66f97cb0-1b0f-47d4-aa54-146e17bf7add tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:12.470113 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-66f97cb0-1b0f-47d4-aa54-146e17bf7add tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.693212 Jun 29 11:25:12.471272 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 42/99] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:11 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:12.536882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d97dcbda-897b-45eb-9632-72ffa5f891f5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:12.550403 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d97dcbda-897b-45eb-9632-72ffa5f891f5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.566785 Jun 29 11:25:12.551130 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 58/100] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:11 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:12.584848 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0053e506-2aba-4a11-bd24-c59a4a00ea82 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:12.585495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0053e506-2aba-4a11-bd24-c59a4a00ea82 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:12.607165 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0053e506-2aba-4a11-bd24-c59a4a00ea82 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:12.608152 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0053e506-2aba-4a11-bd24-c59a4a00ea82 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:12.609112 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0053e506-2aba-4a11-bd24-c59a4a00ea82 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:12.609708 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0053e506-2aba-4a11-bd24-c59a4a00ea82 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:13.013352 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-1988ea08-135e-4ae0-b972-ecf10ed9a344 req-00de5306-3368-4b3c-9be1-8ef7695730ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9821f7d-2d75-40ae-b7a1-81bd38b28a26", "tag": "e421f408-a03a-4b88-9f92-6c06ba04c28d"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:25:13.038129 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1988ea08-135e-4ae0-b972-ecf10ed9a344 req-00de5306-3368-4b3c-9be1-8ef7695730ab service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:13.040211 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1988ea08-135e-4ae0-b972-ecf10ed9a344 req-00de5306-3368-4b3c-9be1-8ef7695730ab service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:13.089577 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-1988ea08-135e-4ae0-b972-ecf10ed9a344 req-00de5306-3368-4b3c-9be1-8ef7695730ab service nova] Creating event network-changed:e421f408-a03a-4b88-9f92-6c06ba04c28d for instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 on hv-cinder-84733 Jun 29 11:25:13.092620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1988ea08-135e-4ae0-b972-ecf10ed9a344 req-00de5306-3368-4b3c-9be1-8ef7695730ab service nova] Acquired lock "compute-rpcapi-router" {{(pid=117921) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 29 11:25:13.092620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e94b3a6-932b-4102-be1e-8780133b9242 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:13.092620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e94b3a6-932b-4102-be1e-8780133b9242 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:13.095083 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e94b3a6-932b-4102-be1e-8780133b9242 None None] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:13.096165 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e94b3a6-932b-4102-be1e-8780133b9242 None None] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:13.124313 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.compute.rpcapi [None req-9e94b3a6-932b-4102-be1e-8780133b9242 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 29 11:25:13.125210 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e94b3a6-932b-4102-be1e-8780133b9242 None None] Releasing lock "compute-rpcapi-router" {{(pid=117921) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 29 11:25:13.183384 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9e94b3a6-932b-4102-be1e-8780133b9242 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.708548 Jun 29 11:25:13.184179 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 43/101] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:13.268248 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0053e506-2aba-4a11-bd24-c59a4a00ea82 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:13.282059 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0053e506-2aba-4a11-bd24-c59a4a00ea82 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.707889 Jun 29 11:25:13.287612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 59/102] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:12 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:13.361773 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-0c7617d8-7c9c-448c-bb0b-ddf491758e40 req-71455236-f270-4e6e-a8e8-33235fea3738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b02fe76c-c085-47fd-87a6-e650d39f6a4c", "tag": "8177ac60-ca71-481f-875b-657d98a48d6d"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:25:13.372439 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-0c7617d8-7c9c-448c-bb0b-ddf491758e40 req-71455236-f270-4e6e-a8e8-33235fea3738 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:13.373652 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-0c7617d8-7c9c-448c-bb0b-ddf491758e40 req-71455236-f270-4e6e-a8e8-33235fea3738 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:13.386137 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-0c7617d8-7c9c-448c-bb0b-ddf491758e40 req-71455236-f270-4e6e-a8e8-33235fea3738 service nova] Creating event network-changed:8177ac60-ca71-481f-875b-657d98a48d6d for instance b02fe76c-c085-47fd-87a6-e650d39f6a4c on hv-cinder-84733 Jun 29 11:25:13.393855 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-0c7617d8-7c9c-448c-bb0b-ddf491758e40 req-71455236-f270-4e6e-a8e8-33235fea3738 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207794 Jun 29 11:25:13.395171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 44/103] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:13.490771 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a482cdea-e96b-4595-b766-1f90bf4cc3a6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:13.492211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a482cdea-e96b-4595-b766-1f90bf4cc3a6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:13.500354 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a482cdea-e96b-4595-b766-1f90bf4cc3a6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:13.502393 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a482cdea-e96b-4595-b766-1f90bf4cc3a6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:13.503547 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a482cdea-e96b-4595-b766-1f90bf4cc3a6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:13.504250 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a482cdea-e96b-4595-b766-1f90bf4cc3a6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:13.568619 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-635eb4a1-e92f-48db-869f-03ae7ed8028c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:13.569326 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-635eb4a1-e92f-48db-869f-03ae7ed8028c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:13.577186 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-635eb4a1-e92f-48db-869f-03ae7ed8028c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:13.578153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-635eb4a1-e92f-48db-869f-03ae7ed8028c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:13.579253 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-635eb4a1-e92f-48db-869f-03ae7ed8028c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:13.579909 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-635eb4a1-e92f-48db-869f-03ae7ed8028c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:13.887163 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-635eb4a1-e92f-48db-869f-03ae7ed8028c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:13.898109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-635eb4a1-e92f-48db-869f-03ae7ed8028c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.333866 Jun 29 11:25:13.899336 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 45/104] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:13 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:13.989131 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a482cdea-e96b-4595-b766-1f90bf4cc3a6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:13.996737 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a482cdea-e96b-4595-b766-1f90bf4cc3a6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.512877 Jun 29 11:25:13.997557 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 60/105] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:13 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:14.298655 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1dd3efc6-e148-469e-9741-48ee7b05e4bc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:14.299492 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1dd3efc6-e148-469e-9741-48ee7b05e4bc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:14.308504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1dd3efc6-e148-469e-9741-48ee7b05e4bc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:14.308504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1dd3efc6-e148-469e-9741-48ee7b05e4bc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:14.308504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1dd3efc6-e148-469e-9741-48ee7b05e4bc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:14.308504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1dd3efc6-e148-469e-9741-48ee7b05e4bc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:14.437721 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1dd3efc6-e148-469e-9741-48ee7b05e4bc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:14.445036 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1dd3efc6-e148-469e-9741-48ee7b05e4bc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.150227 Jun 29 11:25:14.445609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 46/106] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:14 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:14.920650 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e56bc64c-d2b6-40a8-9251-f5838f86acfa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:14.921270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e56bc64c-d2b6-40a8-9251-f5838f86acfa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:14.925455 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:14.931411 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e56bc64c-d2b6-40a8-9251-f5838f86acfa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:14.931879 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e56bc64c-d2b6-40a8-9251-f5838f86acfa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:14.932648 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e56bc64c-d2b6-40a8-9251-f5838f86acfa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:14.933392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e56bc64c-d2b6-40a8-9251-f5838f86acfa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:15.015110 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0c35329d-2f66-4345-869f-043cf4272c09 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:15.015923 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0c35329d-2f66-4345-869f-043cf4272c09 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:15.022559 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c35329d-2f66-4345-869f-043cf4272c09 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:15.022983 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c35329d-2f66-4345-869f-043cf4272c09 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:15.023767 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c35329d-2f66-4345-869f-043cf4272c09 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:15.024228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c35329d-2f66-4345-869f-043cf4272c09 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:15.146463 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e56bc64c-d2b6-40a8-9251-f5838f86acfa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:15.155577 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e56bc64c-d2b6-40a8-9251-f5838f86acfa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.243415 Jun 29 11:25:15.160373 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 61/107] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:14 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:15.220639 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-ea48a72a-64bd-43f0-a49f-33514546efc4 req-8f48082b-a2c8-42dd-8fac-f73355dc15c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864", "tag": "76b84543-437b-474d-9e8d-b044b0c7d460"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:25:15.238519 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ea48a72a-64bd-43f0-a49f-33514546efc4 req-8f48082b-a2c8-42dd-8fac-f73355dc15c0 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:15.239504 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ea48a72a-64bd-43f0-a49f-33514546efc4 req-8f48082b-a2c8-42dd-8fac-f73355dc15c0 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:15.266494 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-ea48a72a-64bd-43f0-a49f-33514546efc4 req-8f48082b-a2c8-42dd-8fac-f73355dc15c0 service nova] Creating event network-changed:76b84543-437b-474d-9e8d-b044b0c7d460 for instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 on hv-cinder-84733 Jun 29 11:25:15.267396 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ea48a72a-64bd-43f0-a49f-33514546efc4 req-8f48082b-a2c8-42dd-8fac-f73355dc15c0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 29 11:25:15.278406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6d3a864-a4f2-4ae0-86ed-e6f1202d1e6c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:15.278406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6d3a864-a4f2-4ae0-86ed-e6f1202d1e6c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:15.278406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6d3a864-a4f2-4ae0-86ed-e6f1202d1e6c None None] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:15.278406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6d3a864-a4f2-4ae0-86ed-e6f1202d1e6c None None] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:15.280981 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.compute.rpcapi [None req-b6d3a864-a4f2-4ae0-86ed-e6f1202d1e6c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 29 11:25:15.281851 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6d3a864-a4f2-4ae0-86ed-e6f1202d1e6c None None] Releasing lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 29 11:25:15.288263 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0c35329d-2f66-4345-869f-043cf4272c09 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:15.298449 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0c35329d-2f66-4345-869f-043cf4272c09 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.287640 Jun 29 11:25:15.299633 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 47/108] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:15 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:15.312824 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b6d3a864-a4f2-4ae0-86ed-e6f1202d1e6c None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096100 Jun 29 11:25:15.313774 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 62/109] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:25:15.436926 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-c6d7bc32-689e-4d3d-aea2-a239cf6a4e7d req-482448ee-f0d7-4e42-9ee5-3df1f927f4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e", "tag": "e66cf1ae-bf64-468d-bdce-a480ba5ff33d"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:25:15.446002 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c6d7bc32-689e-4d3d-aea2-a239cf6a4e7d req-482448ee-f0d7-4e42-9ee5-3df1f927f4b5 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:15.446496 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c6d7bc32-689e-4d3d-aea2-a239cf6a4e7d req-482448ee-f0d7-4e42-9ee5-3df1f927f4b5 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:15.462707 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1ea28a02-d803-4ff3-a669-1cb377a1575f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:15.463465 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-c6d7bc32-689e-4d3d-aea2-a239cf6a4e7d req-482448ee-f0d7-4e42-9ee5-3df1f927f4b5 service nova] Creating event network-changed:e66cf1ae-bf64-468d-bdce-a480ba5ff33d for instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e on hv-cinder-84733 Jun 29 11:25:15.464431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1ea28a02-d803-4ff3-a669-1cb377a1575f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:15.474805 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-c6d7bc32-689e-4d3d-aea2-a239cf6a4e7d req-482448ee-f0d7-4e42-9ee5-3df1f927f4b5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041496 Jun 29 11:25:15.480002 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 48/110] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:15.485150 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ea28a02-d803-4ff3-a669-1cb377a1575f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:15.485612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ea28a02-d803-4ff3-a669-1cb377a1575f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:15.486806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ea28a02-d803-4ff3-a669-1cb377a1575f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:15.487776 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ea28a02-d803-4ff3-a669-1cb377a1575f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:15.700215 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1ea28a02-d803-4ff3-a669-1cb377a1575f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:15.707563 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1ea28a02-d803-4ff3-a669-1cb377a1575f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.249649 Jun 29 11:25:15.713669 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 63/111] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:15 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:16.176250 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ebac7280-faf3-4a08-b854-fbe22af68001 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:16.177433 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ebac7280-faf3-4a08-b854-fbe22af68001 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:16.203798 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebac7280-faf3-4a08-b854-fbe22af68001 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:16.204274 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebac7280-faf3-4a08-b854-fbe22af68001 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:16.205100 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebac7280-faf3-4a08-b854-fbe22af68001 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:16.206652 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebac7280-faf3-4a08-b854-fbe22af68001 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:16.317167 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-798e9fbd-99be-4253-beb4-2f3f0b8cf582 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:16.318424 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-798e9fbd-99be-4253-beb4-2f3f0b8cf582 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:16.330009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-798e9fbd-99be-4253-beb4-2f3f0b8cf582 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:16.333610 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-798e9fbd-99be-4253-beb4-2f3f0b8cf582 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:16.333842 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-798e9fbd-99be-4253-beb4-2f3f0b8cf582 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:16.334400 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-798e9fbd-99be-4253-beb4-2f3f0b8cf582 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:16.646384 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ebac7280-faf3-4a08-b854-fbe22af68001 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:16.655509 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ebac7280-faf3-4a08-b854-fbe22af68001 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.485943 Jun 29 11:25:16.666441 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 49/112] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:16 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:16.676992 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-798e9fbd-99be-4253-beb4-2f3f0b8cf582 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:16.686187 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-798e9fbd-99be-4253-beb4-2f3f0b8cf582 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.372489 Jun 29 11:25:16.686773 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 64/113] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:16 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:16.729956 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e3cdc636-7f40-4085-839b-dc7df12afe3e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:16.736514 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e3cdc636-7f40-4085-839b-dc7df12afe3e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:16.739150 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3cdc636-7f40-4085-839b-dc7df12afe3e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:16.740720 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3cdc636-7f40-4085-839b-dc7df12afe3e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:16.742008 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3cdc636-7f40-4085-839b-dc7df12afe3e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:16.744291 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3cdc636-7f40-4085-839b-dc7df12afe3e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:17.014245 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e3cdc636-7f40-4085-839b-dc7df12afe3e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:17.024571 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e3cdc636-7f40-4085-839b-dc7df12afe3e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.299078 Jun 29 11:25:17.027491 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 50/114] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:16 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:17.673256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bd5b3f56-df2a-4f31-8733-bb65c57b5f76 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:17.674134 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd5b3f56-df2a-4f31-8733-bb65c57b5f76 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:17.681290 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd5b3f56-df2a-4f31-8733-bb65c57b5f76 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:17.683719 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd5b3f56-df2a-4f31-8733-bb65c57b5f76 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:17.683719 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd5b3f56-df2a-4f31-8733-bb65c57b5f76 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:17.683719 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd5b3f56-df2a-4f31-8733-bb65c57b5f76 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:17.705749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ef43f2c6-613e-4596-b928-626d0f1d125f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:17.707071 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ef43f2c6-613e-4596-b928-626d0f1d125f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:17.715345 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef43f2c6-613e-4596-b928-626d0f1d125f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:17.724237 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef43f2c6-613e-4596-b928-626d0f1d125f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:17.729375 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef43f2c6-613e-4596-b928-626d0f1d125f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:17.732202 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef43f2c6-613e-4596-b928-626d0f1d125f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:17.879891 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd5b3f56-df2a-4f31-8733-bb65c57b5f76 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:17.888242 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bd5b3f56-df2a-4f31-8733-bb65c57b5f76 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.219091 Jun 29 11:25:17.889039 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 65/115] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:17 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:17.927147 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ef43f2c6-613e-4596-b928-626d0f1d125f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:17.936058 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ef43f2c6-613e-4596-b928-626d0f1d125f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.236462 Jun 29 11:25:17.936936 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 51/116] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:17 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:18.045117 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b871ecb8-200e-41c4-b7a0-8d4ffdb29b4a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:18.045729 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b871ecb8-200e-41c4-b7a0-8d4ffdb29b4a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:18.052150 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b871ecb8-200e-41c4-b7a0-8d4ffdb29b4a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:18.052609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b871ecb8-200e-41c4-b7a0-8d4ffdb29b4a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:18.053368 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b871ecb8-200e-41c4-b7a0-8d4ffdb29b4a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:18.053805 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b871ecb8-200e-41c4-b7a0-8d4ffdb29b4a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:18.203898 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b871ecb8-200e-41c4-b7a0-8d4ffdb29b4a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:18.211786 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b871ecb8-200e-41c4-b7a0-8d4ffdb29b4a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.170495 Jun 29 11:25:18.212484 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 66/117] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:18 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:18.907394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ed2ca5f6-cbd1-48c3-bdb1-84ddf6088de3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:18.908034 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ed2ca5f6-cbd1-48c3-bdb1-84ddf6088de3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:18.920352 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ed2ca5f6-cbd1-48c3-bdb1-84ddf6088de3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:18.921316 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ed2ca5f6-cbd1-48c3-bdb1-84ddf6088de3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:18.926646 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ed2ca5f6-cbd1-48c3-bdb1-84ddf6088de3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:18.926802 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ed2ca5f6-cbd1-48c3-bdb1-84ddf6088de3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:18.953924 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-376eb38b-b9fa-4bd6-b1e7-e64b4fccd284 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:18.954646 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-376eb38b-b9fa-4bd6-b1e7-e64b4fccd284 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:18.970749 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-376eb38b-b9fa-4bd6-b1e7-e64b4fccd284 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:18.977209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-376eb38b-b9fa-4bd6-b1e7-e64b4fccd284 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:18.979315 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-376eb38b-b9fa-4bd6-b1e7-e64b4fccd284 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:18.981356 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-376eb38b-b9fa-4bd6-b1e7-e64b4fccd284 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:19.027700 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:19.174621 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ed2ca5f6-cbd1-48c3-bdb1-84ddf6088de3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:19.182726 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ed2ca5f6-cbd1-48c3-bdb1-84ddf6088de3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.280955 Jun 29 11:25:19.183287 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 52/118] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:18 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:19.205267 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-376eb38b-b9fa-4bd6-b1e7-e64b4fccd284 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:19.213875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-376eb38b-b9fa-4bd6-b1e7-e64b4fccd284 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.264152 Jun 29 11:25:19.223352 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 67/119] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:18 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:19.229632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8bbdf602-c881-4b03-bcca-894963a3421c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:19.230235 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8bbdf602-c881-4b03-bcca-894963a3421c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:19.236551 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bbdf602-c881-4b03-bcca-894963a3421c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:19.236994 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bbdf602-c881-4b03-bcca-894963a3421c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:19.237784 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bbdf602-c881-4b03-bcca-894963a3421c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:19.238217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bbdf602-c881-4b03-bcca-894963a3421c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:19.259164 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:19.380202 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8bbdf602-c881-4b03-bcca-894963a3421c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:19.388164 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8bbdf602-c881-4b03-bcca-894963a3421c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.162775 Jun 29 11:25:19.388739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 53/120] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:19 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:19.521741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-b30ec3ec-c636-449f-ae79-21d8c6893978 req-0091283e-6c08-4c02-82a6-f7ed2066608c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9821f7d-2d75-40ae-b7a1-81bd38b28a26", "name": "network-vif-plugged", "status": "completed", "tag": "e421f408-a03a-4b88-9f92-6c06ba04c28d"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:25:19.530288 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b30ec3ec-c636-449f-ae79-21d8c6893978 req-0091283e-6c08-4c02-82a6-f7ed2066608c service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:19.530720 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b30ec3ec-c636-449f-ae79-21d8c6893978 req-0091283e-6c08-4c02-82a6-f7ed2066608c service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:19.542128 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-b30ec3ec-c636-449f-ae79-21d8c6893978 req-0091283e-6c08-4c02-82a6-f7ed2066608c service nova] Creating event network-vif-plugged:e421f408-a03a-4b88-9f92-6c06ba04c28d for instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 on hv-cinder-84733 Jun 29 11:25:19.547244 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-b30ec3ec-c636-449f-ae79-21d8c6893978 req-0091283e-6c08-4c02-82a6-f7ed2066608c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104810 Jun 29 11:25:19.547818 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 68/121] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:20.200782 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-40224b2d-d1eb-499b-898f-9441d94063e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:20.201393 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-40224b2d-d1eb-499b-898f-9441d94063e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:20.217445 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40224b2d-d1eb-499b-898f-9441d94063e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:20.217445 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40224b2d-d1eb-499b-898f-9441d94063e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:20.217445 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40224b2d-d1eb-499b-898f-9441d94063e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:20.217445 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40224b2d-d1eb-499b-898f-9441d94063e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:20.231193 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7db18420-7eb3-42a2-9614-212601a5f1e6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:20.232260 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7db18420-7eb3-42a2-9614-212601a5f1e6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:20.240896 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7db18420-7eb3-42a2-9614-212601a5f1e6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:20.241309 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7db18420-7eb3-42a2-9614-212601a5f1e6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:20.242346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7db18420-7eb3-42a2-9614-212601a5f1e6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:20.244256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7db18420-7eb3-42a2-9614-212601a5f1e6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:20.444023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-40224b2d-d1eb-499b-898f-9441d94063e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:20.453750 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-40224b2d-d1eb-499b-898f-9441d94063e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.257719 Jun 29 11:25:20.464359 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 54/122] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:20 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:20.469256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7db18420-7eb3-42a2-9614-212601a5f1e6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:20.476988 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7db18420-7eb3-42a2-9614-212601a5f1e6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.250221 Jun 29 11:25:20.477581 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 69/123] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:20 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:20.480554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2f3ec3da-3867-4790-8ebd-c2b2087cdc7a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:20.481592 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2f3ec3da-3867-4790-8ebd-c2b2087cdc7a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:20.488183 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f3ec3da-3867-4790-8ebd-c2b2087cdc7a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:20.488695 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f3ec3da-3867-4790-8ebd-c2b2087cdc7a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:20.489657 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f3ec3da-3867-4790-8ebd-c2b2087cdc7a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:20.490009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f3ec3da-3867-4790-8ebd-c2b2087cdc7a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:20.632861 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2f3ec3da-3867-4790-8ebd-c2b2087cdc7a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:20.641140 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2f3ec3da-3867-4790-8ebd-c2b2087cdc7a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.165198 Jun 29 11:25:20.641838 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 55/124] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:20 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:21.471528 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c36c148e-a887-477d-9622-d97a42d18376 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:21.472386 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c36c148e-a887-477d-9622-d97a42d18376 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:21.478916 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c36c148e-a887-477d-9622-d97a42d18376 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:21.479428 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c36c148e-a887-477d-9622-d97a42d18376 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:21.480204 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c36c148e-a887-477d-9622-d97a42d18376 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:21.480777 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c36c148e-a887-477d-9622-d97a42d18376 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:21.494909 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ad0ba228-a316-49fc-b98a-b995df8202d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:21.495502 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ad0ba228-a316-49fc-b98a-b995df8202d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:21.502676 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ad0ba228-a316-49fc-b98a-b995df8202d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:21.503265 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ad0ba228-a316-49fc-b98a-b995df8202d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:21.504247 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ad0ba228-a316-49fc-b98a-b995df8202d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:21.504696 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ad0ba228-a316-49fc-b98a-b995df8202d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:21.834839 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c36c148e-a887-477d-9622-d97a42d18376 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:21.846069 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ad0ba228-a316-49fc-b98a-b995df8202d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:21.847094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c36c148e-a887-477d-9622-d97a42d18376 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.380439 Jun 29 11:25:21.848072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 70/125] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:21 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:21.853232 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-115fa299-5519-4b49-8ab3-48efcd6b1ded req-36f42c96-df20-458c-b5f6-d753a4554f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e", "name": "network-vif-plugged", "status": "completed", "tag": "e66cf1ae-bf64-468d-bdce-a480ba5ff33d"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:25:21.861756 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-115fa299-5519-4b49-8ab3-48efcd6b1ded req-36f42c96-df20-458c-b5f6-d753a4554f59 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:21.862027 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ad0ba228-a316-49fc-b98a-b995df8202d6 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.372214 Jun 29 11:25:21.862543 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-115fa299-5519-4b49-8ab3-48efcd6b1ded req-36f42c96-df20-458c-b5f6-d753a4554f59 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:21.862931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 56/126] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:21 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:21.870103 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-100f36af-51af-4e2d-879f-84ac6b0d2ab1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:21.871046 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-100f36af-51af-4e2d-879f-84ac6b0d2ab1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:21.876388 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-115fa299-5519-4b49-8ab3-48efcd6b1ded req-36f42c96-df20-458c-b5f6-d753a4554f59 service nova] Creating event network-vif-plugged:e66cf1ae-bf64-468d-bdce-a480ba5ff33d for instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e on hv-cinder-84733 Jun 29 11:25:21.877847 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-100f36af-51af-4e2d-879f-84ac6b0d2ab1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:21.878364 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-100f36af-51af-4e2d-879f-84ac6b0d2ab1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:21.879462 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-100f36af-51af-4e2d-879f-84ac6b0d2ab1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:21.881893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-100f36af-51af-4e2d-879f-84ac6b0d2ab1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:21.888040 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-115fa299-5519-4b49-8ab3-48efcd6b1ded req-36f42c96-df20-458c-b5f6-d753a4554f59 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038566 Jun 29 11:25:21.888667 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 71/127] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:22.179704 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-100f36af-51af-4e2d-879f-84ac6b0d2ab1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:22.188782 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-100f36af-51af-4e2d-879f-84ac6b0d2ab1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.324150 Jun 29 11:25:22.189757 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 57/128] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:21 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:22.864307 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8afefe4e-fda8-4f0c-bdcd-b502ed9ef0d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:22.865004 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8afefe4e-fda8-4f0c-bdcd-b502ed9ef0d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:22.871179 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8afefe4e-fda8-4f0c-bdcd-b502ed9ef0d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:22.871615 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8afefe4e-fda8-4f0c-bdcd-b502ed9ef0d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:22.872397 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8afefe4e-fda8-4f0c-bdcd-b502ed9ef0d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:22.872835 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8afefe4e-fda8-4f0c-bdcd-b502ed9ef0d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:22.878804 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e7458810-9376-4e44-b149-24c5c9f5943b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:22.879420 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e7458810-9376-4e44-b149-24c5c9f5943b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:22.886468 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7458810-9376-4e44-b149-24c5c9f5943b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:22.890258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7458810-9376-4e44-b149-24c5c9f5943b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:22.890258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7458810-9376-4e44-b149-24c5c9f5943b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:22.890258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7458810-9376-4e44-b149-24c5c9f5943b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:23.124886 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:23.130602 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8afefe4e-fda8-4f0c-bdcd-b502ed9ef0d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:23.146520 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e7458810-9376-4e44-b149-24c5c9f5943b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:23.163935 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8afefe4e-fda8-4f0c-bdcd-b502ed9ef0d5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.302700 Jun 29 11:25:23.164624 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e7458810-9376-4e44-b149-24c5c9f5943b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.288591 Jun 29 11:25:23.165907 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 72/129] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:22 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:23.166021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 58/130] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:22 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:23.205080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2f246f47-44a3-443f-b9ad-75afbe0b2865 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:23.205686 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2f246f47-44a3-443f-b9ad-75afbe0b2865 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:23.211612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f246f47-44a3-443f-b9ad-75afbe0b2865 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:23.212158 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f246f47-44a3-443f-b9ad-75afbe0b2865 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:23.212910 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f246f47-44a3-443f-b9ad-75afbe0b2865 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:23.213572 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f246f47-44a3-443f-b9ad-75afbe0b2865 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:23.417311 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2f246f47-44a3-443f-b9ad-75afbe0b2865 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:23.424560 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2f246f47-44a3-443f-b9ad-75afbe0b2865 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.223348 Jun 29 11:25:23.425120 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 73/131] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:23 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:24.186051 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b1859207-3f99-4822-83c5-aa393f1f361a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:24.188021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5e63e145-25ed-4386-9789-793da4a22825 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:24.189023 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b1859207-3f99-4822-83c5-aa393f1f361a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:24.189433 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5e63e145-25ed-4386-9789-793da4a22825 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:24.195862 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1859207-3f99-4822-83c5-aa393f1f361a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:24.196340 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1859207-3f99-4822-83c5-aa393f1f361a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:24.200697 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1859207-3f99-4822-83c5-aa393f1f361a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:24.200697 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1859207-3f99-4822-83c5-aa393f1f361a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:24.200862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e63e145-25ed-4386-9789-793da4a22825 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:24.200862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e63e145-25ed-4386-9789-793da4a22825 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:24.200862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e63e145-25ed-4386-9789-793da4a22825 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:24.200862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e63e145-25ed-4386-9789-793da4a22825 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:24.409798 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b1859207-3f99-4822-83c5-aa393f1f361a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:24.414751 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5e63e145-25ed-4386-9789-793da4a22825 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:24.418477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b1859207-3f99-4822-83c5-aa393f1f361a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.240406 Jun 29 11:25:24.419812 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 74/132] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:24 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:24.427043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5e63e145-25ed-4386-9789-793da4a22825 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.245549 Jun 29 11:25:24.429199 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 59/133] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:24 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:24.441530 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a62a823d-e238-454b-875a-1f37507c7a2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:24.442287 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a62a823d-e238-454b-875a-1f37507c7a2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:24.449570 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a62a823d-e238-454b-875a-1f37507c7a2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:24.450260 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a62a823d-e238-454b-875a-1f37507c7a2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:24.451027 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a62a823d-e238-454b-875a-1f37507c7a2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:24.451457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a62a823d-e238-454b-875a-1f37507c7a2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:24.585467 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a62a823d-e238-454b-875a-1f37507c7a2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:24.596278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a62a823d-e238-454b-875a-1f37507c7a2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.159270 Jun 29 11:25:24.596975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 75/134] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:24 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:25.436785 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f8e67c59-625d-479b-9e43-96dc130380be tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:25.437386 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f8e67c59-625d-479b-9e43-96dc130380be tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:25.443352 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f8e67c59-625d-479b-9e43-96dc130380be tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:25.443800 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f8e67c59-625d-479b-9e43-96dc130380be tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:25.444575 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f8e67c59-625d-479b-9e43-96dc130380be tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:25.445002 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f8e67c59-625d-479b-9e43-96dc130380be tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:25.445775 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cd97046b-0fc2-46a9-a8c6-bb3f72f8cb57 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:25.446506 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cd97046b-0fc2-46a9-a8c6-bb3f72f8cb57 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:25.448481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:25.453223 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd97046b-0fc2-46a9-a8c6-bb3f72f8cb57 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:25.453674 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd97046b-0fc2-46a9-a8c6-bb3f72f8cb57 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:25.454431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd97046b-0fc2-46a9-a8c6-bb3f72f8cb57 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:25.454924 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd97046b-0fc2-46a9-a8c6-bb3f72f8cb57 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:25.630520 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f8e67c59-625d-479b-9e43-96dc130380be tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:25.638016 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f8e67c59-625d-479b-9e43-96dc130380be tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.205088 Jun 29 11:25:25.647434 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 60/135] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:25 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:25.653712 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cd97046b-0fc2-46a9-a8c6-bb3f72f8cb57 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:25.661427 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cd97046b-0fc2-46a9-a8c6-bb3f72f8cb57 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.219428 Jun 29 11:25:25.674486 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8f11a2e6-0e53-4508-b48b-bd324777f2c1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:25.674486 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8f11a2e6-0e53-4508-b48b-bd324777f2c1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:25.674745 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 76/136] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:25 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:25.674910 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f11a2e6-0e53-4508-b48b-bd324777f2c1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:25.674910 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f11a2e6-0e53-4508-b48b-bd324777f2c1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:25.674910 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f11a2e6-0e53-4508-b48b-bd324777f2c1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:25.675294 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f11a2e6-0e53-4508-b48b-bd324777f2c1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:25.810713 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8f11a2e6-0e53-4508-b48b-bd324777f2c1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:25.818732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8f11a2e6-0e53-4508-b48b-bd324777f2c1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.168780 Jun 29 11:25:25.819305 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 61/137] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:25 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:26.654008 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a7e1228-cb8b-4ab9-bdd6-aab5e73d2d07 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:26.654642 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a7e1228-cb8b-4ab9-bdd6-aab5e73d2d07 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:26.660840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a7e1228-cb8b-4ab9-bdd6-aab5e73d2d07 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:26.661220 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a7e1228-cb8b-4ab9-bdd6-aab5e73d2d07 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:26.661976 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a7e1228-cb8b-4ab9-bdd6-aab5e73d2d07 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:26.662410 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a7e1228-cb8b-4ab9-bdd6-aab5e73d2d07 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:26.692431 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-77e18bc2-e7ee-419e-8450-f950ff1c1478 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:26.693876 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-77e18bc2-e7ee-419e-8450-f950ff1c1478 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:26.704331 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-77e18bc2-e7ee-419e-8450-f950ff1c1478 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:26.704331 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-77e18bc2-e7ee-419e-8450-f950ff1c1478 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:26.705416 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-77e18bc2-e7ee-419e-8450-f950ff1c1478 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:26.705856 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-77e18bc2-e7ee-419e-8450-f950ff1c1478 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:26.866612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a7e1228-cb8b-4ab9-bdd6-aab5e73d2d07 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:26.875358 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a7e1228-cb8b-4ab9-bdd6-aab5e73d2d07 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.225455 Jun 29 11:25:26.876376 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 77/138] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:26 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:26.881052 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-af0e8eba-3f7d-47d2-a2c9-fc07454de8e1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:26.881779 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-af0e8eba-3f7d-47d2-a2c9-fc07454de8e1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:26.887556 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af0e8eba-3f7d-47d2-a2c9-fc07454de8e1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:26.888277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af0e8eba-3f7d-47d2-a2c9-fc07454de8e1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:26.888805 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af0e8eba-3f7d-47d2-a2c9-fc07454de8e1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:26.889538 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-af0e8eba-3f7d-47d2-a2c9-fc07454de8e1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:26.897118 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-77e18bc2-e7ee-419e-8450-f950ff1c1478 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:26.918270 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-77e18bc2-e7ee-419e-8450-f950ff1c1478 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.232522 Jun 29 11:25:26.933655 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 62/139] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:26 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:27.054179 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-af0e8eba-3f7d-47d2-a2c9-fc07454de8e1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:27.068233 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-af0e8eba-3f7d-47d2-a2c9-fc07454de8e1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.184342 Jun 29 11:25:27.068233 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 78/140] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:26 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:27.892001 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1cd88662-cae3-4713-a205-c5061c91b6a0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:27.892599 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1cd88662-cae3-4713-a205-c5061c91b6a0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:27.901371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1cd88662-cae3-4713-a205-c5061c91b6a0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:27.905562 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1cd88662-cae3-4713-a205-c5061c91b6a0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:27.906701 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1cd88662-cae3-4713-a205-c5061c91b6a0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:27.907148 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1cd88662-cae3-4713-a205-c5061c91b6a0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:27.942443 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-efa4ef1d-23fa-4b98-a27f-46e3d64ed4aa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:27.943179 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-efa4ef1d-23fa-4b98-a27f-46e3d64ed4aa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:27.952743 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efa4ef1d-23fa-4b98-a27f-46e3d64ed4aa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:27.953200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efa4ef1d-23fa-4b98-a27f-46e3d64ed4aa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:27.953963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efa4ef1d-23fa-4b98-a27f-46e3d64ed4aa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:27.954569 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efa4ef1d-23fa-4b98-a27f-46e3d64ed4aa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:28.412634 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1cd88662-cae3-4713-a205-c5061c91b6a0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:28.417527 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-efa4ef1d-23fa-4b98-a27f-46e3d64ed4aa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:28.421077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1cd88662-cae3-4713-a205-c5061c91b6a0 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.532938 Jun 29 11:25:28.421634 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 63/141] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:27 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:28.426278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-efa4ef1d-23fa-4b98-a27f-46e3d64ed4aa tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.488608 Jun 29 11:25:28.429856 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 79/142] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:27 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:28.429968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8b67ffad-f71f-4b6c-8c88-d51d5923fd09 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:28.429968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8b67ffad-f71f-4b6c-8c88-d51d5923fd09 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:28.435471 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b67ffad-f71f-4b6c-8c88-d51d5923fd09 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:28.436439 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b67ffad-f71f-4b6c-8c88-d51d5923fd09 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:28.436924 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b67ffad-f71f-4b6c-8c88-d51d5923fd09 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:28.437485 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b67ffad-f71f-4b6c-8c88-d51d5923fd09 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:28.577032 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8b67ffad-f71f-4b6c-8c88-d51d5923fd09 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:28.585086 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8b67ffad-f71f-4b6c-8c88-d51d5923fd09 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.162283 Jun 29 11:25:28.585751 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 64/143] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:28 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:28.864142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-0eea1b20-9ade-4888-8d99-7cb2d29e0696 req-59fac888-4188-4961-a11f-a7bf32b3c513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02fe76c-c085-47fd-87a6-e650d39f6a4c", "name": "network-vif-plugged", "status": "completed", "tag": "8177ac60-ca71-481f-875b-657d98a48d6d"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:25:28.872212 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0eea1b20-9ade-4888-8d99-7cb2d29e0696 req-59fac888-4188-4961-a11f-a7bf32b3c513 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:28.872651 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0eea1b20-9ade-4888-8d99-7cb2d29e0696 req-59fac888-4188-4961-a11f-a7bf32b3c513 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:28.883740 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-0eea1b20-9ade-4888-8d99-7cb2d29e0696 req-59fac888-4188-4961-a11f-a7bf32b3c513 service nova] Creating event network-vif-plugged:8177ac60-ca71-481f-875b-657d98a48d6d for instance b02fe76c-c085-47fd-87a6-e650d39f6a4c on hv-cinder-84733 Jun 29 11:25:28.888803 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-0eea1b20-9ade-4888-8d99-7cb2d29e0696 req-59fac888-4188-4961-a11f-a7bf32b3c513 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028486 Jun 29 11:25:28.889652 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 80/144] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:29.439543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6acb0e71-96e8-456c-89e8-55e277e5bd66 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:29.440264 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6acb0e71-96e8-456c-89e8-55e277e5bd66 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:29.444641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ecdf9733-00f3-45e1-9a0e-124da0f14192 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:29.445350 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ecdf9733-00f3-45e1-9a0e-124da0f14192 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:29.446878 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6acb0e71-96e8-456c-89e8-55e277e5bd66 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:29.447328 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6acb0e71-96e8-456c-89e8-55e277e5bd66 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:29.448108 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6acb0e71-96e8-456c-89e8-55e277e5bd66 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:29.448525 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6acb0e71-96e8-456c-89e8-55e277e5bd66 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:29.452073 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecdf9733-00f3-45e1-9a0e-124da0f14192 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:29.452708 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecdf9733-00f3-45e1-9a0e-124da0f14192 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:29.453627 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecdf9733-00f3-45e1-9a0e-124da0f14192 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:29.454060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecdf9733-00f3-45e1-9a0e-124da0f14192 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:29.647240 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6acb0e71-96e8-456c-89e8-55e277e5bd66 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:29.649898 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ecdf9733-00f3-45e1-9a0e-124da0f14192 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:29.654806 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6acb0e71-96e8-456c-89e8-55e277e5bd66 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.219143 Jun 29 11:25:29.655728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 65/145] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:29 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:29.657523 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ecdf9733-00f3-45e1-9a0e-124da0f14192 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.217043 Jun 29 11:25:29.660495 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8818c4b8-9763-4edb-aea4-bc82af5f713a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:29.661245 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8818c4b8-9763-4edb-aea4-bc82af5f713a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:29.666250 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 81/146] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:29 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:29.667893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8818c4b8-9763-4edb-aea4-bc82af5f713a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:29.668341 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8818c4b8-9763-4edb-aea4-bc82af5f713a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:29.669171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8818c4b8-9763-4edb-aea4-bc82af5f713a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:29.669518 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8818c4b8-9763-4edb-aea4-bc82af5f713a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:29.942148 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8818c4b8-9763-4edb-aea4-bc82af5f713a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:29.950272 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8818c4b8-9763-4edb-aea4-bc82af5f713a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.293390 Jun 29 11:25:29.950834 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 66/147] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:29 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:30.672537 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6b30292e-02b7-4ce3-8792-7477dc849b94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:30.673143 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6b30292e-02b7-4ce3-8792-7477dc849b94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:30.674278 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-15300347-175a-421f-84f0-7b1e1f4e8f93 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:30.674890 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-15300347-175a-421f-84f0-7b1e1f4e8f93 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:30.679111 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b30292e-02b7-4ce3-8792-7477dc849b94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:30.679555 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b30292e-02b7-4ce3-8792-7477dc849b94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:30.680874 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b30292e-02b7-4ce3-8792-7477dc849b94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:30.681308 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b30292e-02b7-4ce3-8792-7477dc849b94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:30.681496 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15300347-175a-421f-84f0-7b1e1f4e8f93 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:30.681930 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15300347-175a-421f-84f0-7b1e1f4e8f93 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:30.682656 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15300347-175a-421f-84f0-7b1e1f4e8f93 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:30.683077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15300347-175a-421f-84f0-7b1e1f4e8f93 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:30.952688 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-15300347-175a-421f-84f0-7b1e1f4e8f93 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:30.961946 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6b30292e-02b7-4ce3-8792-7477dc849b94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:30.967623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-15300347-175a-421f-84f0-7b1e1f4e8f93 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.297051 Jun 29 11:25:30.968682 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 67/148] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:30 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:30.971225 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6b30292e-02b7-4ce3-8792-7477dc849b94 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.302466 Jun 29 11:25:30.972113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 82/149] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:30 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:30.973491 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-13cd5662-36ec-42b1-a529-ecfccc0751b1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:30.974085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-13cd5662-36ec-42b1-a529-ecfccc0751b1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:30.980284 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13cd5662-36ec-42b1-a529-ecfccc0751b1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:30.980731 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13cd5662-36ec-42b1-a529-ecfccc0751b1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:30.987290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13cd5662-36ec-42b1-a529-ecfccc0751b1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:30.987290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13cd5662-36ec-42b1-a529-ecfccc0751b1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:31.114427 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-13cd5662-36ec-42b1-a529-ecfccc0751b1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:31.124298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-13cd5662-36ec-42b1-a529-ecfccc0751b1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.154425 Jun 29 11:25:31.124872 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 68/150] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:30 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:31.984193 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ca2ffdad-0881-4e82-ab0c-6fa52e69896f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:31.984876 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ca2ffdad-0881-4e82-ab0c-6fa52e69896f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:31.988727 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-78d87b43-1a6e-4d06-bceb-b92fce2754e4 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:31.989329 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-78d87b43-1a6e-4d06-bceb-b92fce2754e4 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:31.996460 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca2ffdad-0881-4e82-ab0c-6fa52e69896f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:31.996460 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca2ffdad-0881-4e82-ab0c-6fa52e69896f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:31.996460 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca2ffdad-0881-4e82-ab0c-6fa52e69896f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:31.996460 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca2ffdad-0881-4e82-ab0c-6fa52e69896f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:31.996747 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78d87b43-1a6e-4d06-bceb-b92fce2754e4 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:31.996747 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78d87b43-1a6e-4d06-bceb-b92fce2754e4 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:31.996747 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78d87b43-1a6e-4d06-bceb-b92fce2754e4 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:31.997008 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78d87b43-1a6e-4d06-bceb-b92fce2754e4 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:32.184049 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ca2ffdad-0881-4e82-ab0c-6fa52e69896f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:32.188274 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-78d87b43-1a6e-4d06-bceb-b92fce2754e4 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:32.191384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ca2ffdad-0881-4e82-ab0c-6fa52e69896f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.211105 Jun 29 11:25:32.191987 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 83/151] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:31 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:32.196594 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-78d87b43-1a6e-4d06-bceb-b92fce2754e4 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.211646 Jun 29 11:25:32.197033 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-20377ece-6f86-4bda-afa8-419a3358c5c8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:32.197459 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 69/152] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:31 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:32.201331 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-20377ece-6f86-4bda-afa8-419a3358c5c8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:32.207097 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20377ece-6f86-4bda-afa8-419a3358c5c8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:32.207539 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20377ece-6f86-4bda-afa8-419a3358c5c8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:32.208356 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20377ece-6f86-4bda-afa8-419a3358c5c8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:32.208793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-20377ece-6f86-4bda-afa8-419a3358c5c8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:32.333552 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-20377ece-6f86-4bda-afa8-419a3358c5c8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:32.340859 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-20377ece-6f86-4bda-afa8-419a3358c5c8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.147943 Jun 29 11:25:32.341437 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 84/153] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:32 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:33.208373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-adeebd7d-87f6-43d0-a33b-f12be2f12ee0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:33.208977 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-adeebd7d-87f6-43d0-a33b-f12be2f12ee0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:33.210946 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=75 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:33.213135 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e8d9f98b-e5d6-4d9b-849f-da4b2a9b6590 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:33.213777 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e8d9f98b-e5d6-4d9b-849f-da4b2a9b6590 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:33.215672 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-adeebd7d-87f6-43d0-a33b-f12be2f12ee0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:33.216307 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-adeebd7d-87f6-43d0-a33b-f12be2f12ee0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:33.216895 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-adeebd7d-87f6-43d0-a33b-f12be2f12ee0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:33.217323 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-adeebd7d-87f6-43d0-a33b-f12be2f12ee0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:33.220127 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8d9f98b-e5d6-4d9b-849f-da4b2a9b6590 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:33.225688 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8d9f98b-e5d6-4d9b-849f-da4b2a9b6590 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:33.225688 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8d9f98b-e5d6-4d9b-849f-da4b2a9b6590 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:33.225880 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:33.225974 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8d9f98b-e5d6-4d9b-849f-da4b2a9b6590 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:33.438333 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e8d9f98b-e5d6-4d9b-849f-da4b2a9b6590 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:33.442624 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-adeebd7d-87f6-43d0-a33b-f12be2f12ee0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:33.446837 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e8d9f98b-e5d6-4d9b-849f-da4b2a9b6590 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.236508 Jun 29 11:25:33.446837 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 85/154] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:33 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:33.450527 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-adeebd7d-87f6-43d0-a33b-f12be2f12ee0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.245930 Jun 29 11:25:33.452371 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-99b937ed-92ef-4472-bbe7-1f01eaeabaa5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:33.453436 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-99b937ed-92ef-4472-bbe7-1f01eaeabaa5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:33.455873 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 70/155] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:33 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:33.460996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b937ed-92ef-4472-bbe7-1f01eaeabaa5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:33.461480 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b937ed-92ef-4472-bbe7-1f01eaeabaa5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:33.462240 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b937ed-92ef-4472-bbe7-1f01eaeabaa5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:33.464245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99b937ed-92ef-4472-bbe7-1f01eaeabaa5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:33.470492 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:33.598235 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-99b937ed-92ef-4472-bbe7-1f01eaeabaa5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:33.606016 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-99b937ed-92ef-4472-bbe7-1f01eaeabaa5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.158677 Jun 29 11:25:33.606574 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 86/156] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:33 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:34.463055 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-61732d27-24cd-4315-9942-0aa397503733 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:34.463958 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-61732d27-24cd-4315-9942-0aa397503733 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:34.466647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0e54f15e-2e27-4bd9-b6ee-af0ae74a4089 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:34.467312 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0e54f15e-2e27-4bd9-b6ee-af0ae74a4089 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:34.471036 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-61732d27-24cd-4315-9942-0aa397503733 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:34.471482 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-61732d27-24cd-4315-9942-0aa397503733 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:34.472288 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-61732d27-24cd-4315-9942-0aa397503733 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:34.472689 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-61732d27-24cd-4315-9942-0aa397503733 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:34.473736 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e54f15e-2e27-4bd9-b6ee-af0ae74a4089 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:34.474322 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e54f15e-2e27-4bd9-b6ee-af0ae74a4089 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:34.475138 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e54f15e-2e27-4bd9-b6ee-af0ae74a4089 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:34.475574 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e54f15e-2e27-4bd9-b6ee-af0ae74a4089 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:34.698713 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-61732d27-24cd-4315-9942-0aa397503733 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:34.708170 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-61732d27-24cd-4315-9942-0aa397503733 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.249134 Jun 29 11:25:34.709756 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 71/157] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:34 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:34.718065 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0e54f15e-2e27-4bd9-b6ee-af0ae74a4089 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:34.718208 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c81b5250-8ba7-4502-90f3-b5b7db35f00b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:34.719180 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c81b5250-8ba7-4502-90f3-b5b7db35f00b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:34.719295 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0e54f15e-2e27-4bd9-b6ee-af0ae74a4089 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.255960 Jun 29 11:25:34.719966 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 87/158] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:34 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:34.724754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c81b5250-8ba7-4502-90f3-b5b7db35f00b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:34.725197 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c81b5250-8ba7-4502-90f3-b5b7db35f00b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:34.725951 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c81b5250-8ba7-4502-90f3-b5b7db35f00b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:34.726382 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c81b5250-8ba7-4502-90f3-b5b7db35f00b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:34.857419 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c81b5250-8ba7-4502-90f3-b5b7db35f00b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:34.865706 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c81b5250-8ba7-4502-90f3-b5b7db35f00b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1361 microversion: 2.1 time: 0.151033 Jun 29 11:25:34.865706 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 72/159] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:34 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:35.730395 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa415ba3-36a0-4eac-b899-5545eab359af tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:35.737433 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aa415ba3-36a0-4eac-b899-5545eab359af tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:35.737904 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4ca88053-8fc0-4f66-ad40-dbb8fce59339 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:35.737904 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4ca88053-8fc0-4f66-ad40-dbb8fce59339 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:35.738406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa415ba3-36a0-4eac-b899-5545eab359af tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:35.738504 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa415ba3-36a0-4eac-b899-5545eab359af tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:35.739398 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa415ba3-36a0-4eac-b899-5545eab359af tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:35.739947 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa415ba3-36a0-4eac-b899-5545eab359af tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:35.742128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ca88053-8fc0-4f66-ad40-dbb8fce59339 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:35.742921 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ca88053-8fc0-4f66-ad40-dbb8fce59339 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:35.744936 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ca88053-8fc0-4f66-ad40-dbb8fce59339 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:35.745370 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ca88053-8fc0-4f66-ad40-dbb8fce59339 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:35.939693 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4ca88053-8fc0-4f66-ad40-dbb8fce59339 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:35.948406 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4ca88053-8fc0-4f66-ad40-dbb8fce59339 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.217689 Jun 29 11:25:35.949148 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 73/160] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:35 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:35.954219 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-4bfea6f0-c208-4cef-811a-d156b6399994 req-89abc92c-6b15-4455-abb1-a602d66b70d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864", "name": "network-vif-plugged", "status": "completed", "tag": "76b84543-437b-474d-9e8d-b044b0c7d460"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:25:35.963664 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa415ba3-36a0-4eac-b899-5545eab359af tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:35.966637 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4bfea6f0-c208-4cef-811a-d156b6399994 req-89abc92c-6b15-4455-abb1-a602d66b70d5 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:35.969202 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4bfea6f0-c208-4cef-811a-d156b6399994 req-89abc92c-6b15-4455-abb1-a602d66b70d5 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:35.971305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aa415ba3-36a0-4eac-b899-5545eab359af tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.249106 Jun 29 11:25:35.971905 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 88/161] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:35 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:35.976423 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c0bc2684-1bf1-4b2d-8a06-f31ec3e1c352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:35.977151 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c0bc2684-1bf1-4b2d-8a06-f31ec3e1c352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:35.979196 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-4bfea6f0-c208-4cef-811a-d156b6399994 req-89abc92c-6b15-4455-abb1-a602d66b70d5 service nova] Creating event network-vif-plugged:76b84543-437b-474d-9e8d-b044b0c7d460 for instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 on hv-cinder-84733 Jun 29 11:25:35.982981 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0bc2684-1bf1-4b2d-8a06-f31ec3e1c352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:35.983425 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0bc2684-1bf1-4b2d-8a06-f31ec3e1c352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:35.984206 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0bc2684-1bf1-4b2d-8a06-f31ec3e1c352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:35.984634 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0bc2684-1bf1-4b2d-8a06-f31ec3e1c352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:35.984725 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-4bfea6f0-c208-4cef-811a-d156b6399994 req-89abc92c-6b15-4455-abb1-a602d66b70d5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034151 Jun 29 11:25:35.985242 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 74/162] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:36.135474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c0bc2684-1bf1-4b2d-8a06-f31ec3e1c352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:36.142918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c0bc2684-1bf1-4b2d-8a06-f31ec3e1c352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1548 microversion: 2.1 time: 0.170072 Jun 29 11:25:36.143481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 89/163] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:35 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:36.165415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-42525096-097a-4bb7-9bd0-527545ad74fe tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:36.165992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-42525096-097a-4bb7-9bd0-527545ad74fe tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:36.172419 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42525096-097a-4bb7-9bd0-527545ad74fe tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:36.172866 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42525096-097a-4bb7-9bd0-527545ad74fe tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:36.173622 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42525096-097a-4bb7-9bd0-527545ad74fe tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:36.174058 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42525096-097a-4bb7-9bd0-527545ad74fe tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:36.327232 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-42525096-097a-4bb7-9bd0-527545ad74fe tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165948 Jun 29 11:25:36.327696 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 75/164] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jun 29 11:25:36 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:36.966002 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7cbc1ab2-e35b-45b4-86a8-dad0fc6241f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:36.966616 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7cbc1ab2-e35b-45b4-86a8-dad0fc6241f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:36.973386 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cbc1ab2-e35b-45b4-86a8-dad0fc6241f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:36.973828 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cbc1ab2-e35b-45b4-86a8-dad0fc6241f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:36.974588 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cbc1ab2-e35b-45b4-86a8-dad0fc6241f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:36.975088 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cbc1ab2-e35b-45b4-86a8-dad0fc6241f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:36.988289 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8f141e43-6450-4afd-8397-8d66be2994ac tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:36.989035 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8f141e43-6450-4afd-8397-8d66be2994ac tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:36.995155 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f141e43-6450-4afd-8397-8d66be2994ac tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:36.995721 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f141e43-6450-4afd-8397-8d66be2994ac tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:36.996601 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f141e43-6450-4afd-8397-8d66be2994ac tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:36.997119 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f141e43-6450-4afd-8397-8d66be2994ac tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:37.329748 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7cbc1ab2-e35b-45b4-86a8-dad0fc6241f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:37.338329 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7cbc1ab2-e35b-45b4-86a8-dad0fc6241f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.376105 Jun 29 11:25:37.339080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 90/165] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:36 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:37.349003 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8f141e43-6450-4afd-8397-8d66be2994ac tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:37.357254 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8f141e43-6450-4afd-8397-8d66be2994ac tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.372498 Jun 29 11:25:37.357934 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 76/166] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:36 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:37.861092 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-305437a2-d294-458c-bc36-656f958f7ddd req-0c4b6980-3da7-4122-851d-f060bbe19a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e", "tag": "e66cf1ae-bf64-468d-bdce-a480ba5ff33d"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:25:37.869055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-305437a2-d294-458c-bc36-656f958f7ddd req-0c4b6980-3da7-4122-851d-f060bbe19a17 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:37.869491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-305437a2-d294-458c-bc36-656f958f7ddd req-0c4b6980-3da7-4122-851d-f060bbe19a17 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:37.880294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-305437a2-d294-458c-bc36-656f958f7ddd req-0c4b6980-3da7-4122-851d-f060bbe19a17 service nova] Creating event network-changed:e66cf1ae-bf64-468d-bdce-a480ba5ff33d for instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e on hv-cinder-84733 Jun 29 11:25:37.885828 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-305437a2-d294-458c-bc36-656f958f7ddd req-0c4b6980-3da7-4122-851d-f060bbe19a17 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028315 Jun 29 11:25:37.886403 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 91/167] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:38.355306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-937b45b0-dc80-497e-af3e-865be5323274 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:38.355961 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-937b45b0-dc80-497e-af3e-865be5323274 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:38.362175 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-937b45b0-dc80-497e-af3e-865be5323274 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:38.362618 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-937b45b0-dc80-497e-af3e-865be5323274 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:38.363371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-937b45b0-dc80-497e-af3e-865be5323274 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:38.363796 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-937b45b0-dc80-497e-af3e-865be5323274 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:38.374134 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3c0b5e36-2e88-4b1f-8f75-234342afbee1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:38.374822 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3c0b5e36-2e88-4b1f-8f75-234342afbee1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:38.386184 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c0b5e36-2e88-4b1f-8f75-234342afbee1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:38.386629 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c0b5e36-2e88-4b1f-8f75-234342afbee1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:38.387557 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c0b5e36-2e88-4b1f-8f75-234342afbee1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:38.388013 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c0b5e36-2e88-4b1f-8f75-234342afbee1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:38.577517 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-937b45b0-dc80-497e-af3e-865be5323274 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:38.585911 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-937b45b0-dc80-497e-af3e-865be5323274 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.234028 Jun 29 11:25:38.587642 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 77/168] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:38 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:38.590088 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3c0b5e36-2e88-4b1f-8f75-234342afbee1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:38.598781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3c0b5e36-2e88-4b1f-8f75-234342afbee1 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.228838 Jun 29 11:25:38.599462 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 92/169] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:38 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:39.602329 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a71773e6-e511-405e-aa9a-6ecabffc363a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:39.602931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a71773e6-e511-405e-aa9a-6ecabffc363a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:39.608936 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a71773e6-e511-405e-aa9a-6ecabffc363a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:39.609406 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a71773e6-e511-405e-aa9a-6ecabffc363a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:39.610149 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a71773e6-e511-405e-aa9a-6ecabffc363a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:39.610574 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a71773e6-e511-405e-aa9a-6ecabffc363a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:39.620371 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b42000ff-76fe-4096-a149-f55d4bbeb990 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:39.620982 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b42000ff-76fe-4096-a149-f55d4bbeb990 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:39.626860 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b42000ff-76fe-4096-a149-f55d4bbeb990 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:39.627306 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b42000ff-76fe-4096-a149-f55d4bbeb990 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:39.628094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b42000ff-76fe-4096-a149-f55d4bbeb990 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:39.628525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b42000ff-76fe-4096-a149-f55d4bbeb990 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:39.807329 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a71773e6-e511-405e-aa9a-6ecabffc363a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:39.815452 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a71773e6-e511-405e-aa9a-6ecabffc363a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.216773 Jun 29 11:25:39.816630 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 78/170] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:39 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:39.834155 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b42000ff-76fe-4096-a149-f55d4bbeb990 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:39.841660 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b42000ff-76fe-4096-a149-f55d4bbeb990 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.225036 Jun 29 11:25:39.842226 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 93/171] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:39 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:40.833305 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c6cd7ca0-b724-4c9a-8047-04f19b6f9832 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:40.833848 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c6cd7ca0-b724-4c9a-8047-04f19b6f9832 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:40.840661 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6cd7ca0-b724-4c9a-8047-04f19b6f9832 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:40.841100 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6cd7ca0-b724-4c9a-8047-04f19b6f9832 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:40.841844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6cd7ca0-b724-4c9a-8047-04f19b6f9832 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:40.842269 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6cd7ca0-b724-4c9a-8047-04f19b6f9832 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:40.858296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1dcf1710-d69b-4cac-905d-8013fbe72d12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:40.858897 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1dcf1710-d69b-4cac-905d-8013fbe72d12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:40.864744 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dcf1710-d69b-4cac-905d-8013fbe72d12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:40.865184 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dcf1710-d69b-4cac-905d-8013fbe72d12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:40.865922 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dcf1710-d69b-4cac-905d-8013fbe72d12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:40.866343 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dcf1710-d69b-4cac-905d-8013fbe72d12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:41.059383 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c6cd7ca0-b724-4c9a-8047-04f19b6f9832 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:41.062264 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1dcf1710-d69b-4cac-905d-8013fbe72d12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:41.068743 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c6cd7ca0-b724-4c9a-8047-04f19b6f9832 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.239219 Jun 29 11:25:41.069671 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 79/172] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:40 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:41.070504 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1dcf1710-d69b-4cac-905d-8013fbe72d12 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.215900 Jun 29 11:25:41.071614 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 94/173] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:40 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:42.087707 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-da14df53-a65b-4fa4-922f-1d00e7837aa4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:42.089032 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-da14df53-a65b-4fa4-922f-1d00e7837aa4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:42.090627 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-776e7596-4387-47af-bc6b-fcba5c66b156 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:42.092777 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-776e7596-4387-47af-bc6b-fcba5c66b156 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:42.106287 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da14df53-a65b-4fa4-922f-1d00e7837aa4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:42.106748 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da14df53-a65b-4fa4-922f-1d00e7837aa4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:42.106862 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-776e7596-4387-47af-bc6b-fcba5c66b156 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:42.107240 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-776e7596-4387-47af-bc6b-fcba5c66b156 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:42.107525 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da14df53-a65b-4fa4-922f-1d00e7837aa4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:42.108413 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-776e7596-4387-47af-bc6b-fcba5c66b156 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:42.108880 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-776e7596-4387-47af-bc6b-fcba5c66b156 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:42.110415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da14df53-a65b-4fa4-922f-1d00e7837aa4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:42.408505 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-da14df53-a65b-4fa4-922f-1d00e7837aa4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:42.412156 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-776e7596-4387-47af-bc6b-fcba5c66b156 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:42.420526 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-776e7596-4387-47af-bc6b-fcba5c66b156 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.336152 Jun 29 11:25:42.421088 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 95/174] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:42 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:42.423624 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-da14df53-a65b-4fa4-922f-1d00e7837aa4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1322 microversion: 2.1 time: 0.341479 Jun 29 11:25:42.424386 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 80/175] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:42 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:43.437822 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-14093ff7-0686-4180-84a6-959031a8deda tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:43.438551 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-14093ff7-0686-4180-84a6-959031a8deda tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:43.442225 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-54491995-caf2-4481-9104-54c5ebc2b874 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:43.442820 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-54491995-caf2-4481-9104-54c5ebc2b874 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:43.444713 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14093ff7-0686-4180-84a6-959031a8deda tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:43.445155 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14093ff7-0686-4180-84a6-959031a8deda tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:43.446487 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14093ff7-0686-4180-84a6-959031a8deda tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:43.446963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14093ff7-0686-4180-84a6-959031a8deda tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:43.452096 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-54491995-caf2-4481-9104-54c5ebc2b874 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:43.452096 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-54491995-caf2-4481-9104-54c5ebc2b874 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:43.453912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-54491995-caf2-4481-9104-54c5ebc2b874 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:43.454355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-54491995-caf2-4481-9104-54c5ebc2b874 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:43.858844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-54491995-caf2-4481-9104-54c5ebc2b874 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:43.866309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-54491995-caf2-4481-9104-54c5ebc2b874 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1516 microversion: 2.1 time: 0.427792 Jun 29 11:25:43.877008 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 81/176] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:43 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1516 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:43.877966 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-14093ff7-0686-4180-84a6-959031a8deda tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:43.877966 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-14093ff7-0686-4180-84a6-959031a8deda tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.442657 Jun 29 11:25:43.877966 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 96/177] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:43 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:43.886099 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b07464b0-426f-43f4-b8ce-dac50aad9aec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:25:43.887292 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b07464b0-426f-43f4-b8ce-dac50aad9aec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:43.893153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b07464b0-426f-43f4-b8ce-dac50aad9aec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:43.893589 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b07464b0-426f-43f4-b8ce-dac50aad9aec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:43.894338 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b07464b0-426f-43f4-b8ce-dac50aad9aec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:43.894780 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b07464b0-426f-43f4-b8ce-dac50aad9aec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:43.926341 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-b07464b0-426f-43f4-b8ce-dac50aad9aec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lazy-loading 'flavor' on Instance uuid b02fe76c-c085-47fd-87a6-e650d39f6a4c {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:25:44.257859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b07464b0-426f-43f4-b8ce-dac50aad9aec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "POST /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c/action" status: 200 len: 32 microversion: 2.1 time: 0.375750 Jun 29 11:25:44.258928 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 82/178] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:25:43 2022] POST /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c/action => generated 32 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 11:25:44.273041 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f5be1fc-6a52-448c-a9a2-a23a85fc8ebc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:44.273655 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8f5be1fc-6a52-448c-a9a2-a23a85fc8ebc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:44.280239 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f5be1fc-6a52-448c-a9a2-a23a85fc8ebc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:44.280676 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f5be1fc-6a52-448c-a9a2-a23a85fc8ebc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:44.281590 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f5be1fc-6a52-448c-a9a2-a23a85fc8ebc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:44.282134 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f5be1fc-6a52-448c-a9a2-a23a85fc8ebc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:44.442381 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8f5be1fc-6a52-448c-a9a2-a23a85fc8ebc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:44.446416 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8f5be1fc-6a52-448c-a9a2-a23a85fc8ebc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.182246 Jun 29 11:25:44.447276 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 97/179] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:44 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:44.893082 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3c29dcaa-0b75-461e-9729-6986e9371c6b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:44.893806 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3c29dcaa-0b75-461e-9729-6986e9371c6b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:44.901298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c29dcaa-0b75-461e-9729-6986e9371c6b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:44.901724 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c29dcaa-0b75-461e-9729-6986e9371c6b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:44.902494 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c29dcaa-0b75-461e-9729-6986e9371c6b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:44.902979 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c29dcaa-0b75-461e-9729-6986e9371c6b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:45.045074 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3c29dcaa-0b75-461e-9729-6986e9371c6b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:45.053141 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3c29dcaa-0b75-461e-9729-6986e9371c6b tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.164204 Jun 29 11:25:45.053712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 83/180] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:44 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:45.465656 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fcc6d3ce-107e-4140-be4e-d6d7e778e8d4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:45.468022 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fcc6d3ce-107e-4140-be4e-d6d7e778e8d4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:45.478487 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcc6d3ce-107e-4140-be4e-d6d7e778e8d4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:45.479034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcc6d3ce-107e-4140-be4e-d6d7e778e8d4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:45.479918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcc6d3ce-107e-4140-be4e-d6d7e778e8d4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:45.480558 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcc6d3ce-107e-4140-be4e-d6d7e778e8d4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:45.610101 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fcc6d3ce-107e-4140-be4e-d6d7e778e8d4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:45.618936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fcc6d3ce-107e-4140-be4e-d6d7e778e8d4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.159171 Jun 29 11:25:45.619853 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 98/181] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:45 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:46.070496 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b1d5774a-631d-48d0-9fba-44a168d89e87 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:46.071676 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b1d5774a-631d-48d0-9fba-44a168d89e87 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:46.077756 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1d5774a-631d-48d0-9fba-44a168d89e87 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:46.078205 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1d5774a-631d-48d0-9fba-44a168d89e87 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:46.078969 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1d5774a-631d-48d0-9fba-44a168d89e87 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:46.079402 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1d5774a-631d-48d0-9fba-44a168d89e87 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:46.208634 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b1d5774a-631d-48d0-9fba-44a168d89e87 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:46.218818 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b1d5774a-631d-48d0-9fba-44a168d89e87 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.152020 Jun 29 11:25:46.219861 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 84/182] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:46 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:46.636858 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2359741-8c7b-453d-bd87-9b34008fbd6d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:46.637974 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e2359741-8c7b-453d-bd87-9b34008fbd6d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:46.640165 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=76 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:46.645220 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2359741-8c7b-453d-bd87-9b34008fbd6d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:46.647369 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2359741-8c7b-453d-bd87-9b34008fbd6d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:46.647369 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2359741-8c7b-453d-bd87-9b34008fbd6d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:46.647369 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2359741-8c7b-453d-bd87-9b34008fbd6d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:46.777161 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e2359741-8c7b-453d-bd87-9b34008fbd6d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:46.790453 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2359741-8c7b-453d-bd87-9b34008fbd6d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.157461 Jun 29 11:25:46.791080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 99/183] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:46 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:47.241230 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-42ab8caa-1999-4e60-b3db-f46b160cb3f7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:47.242912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-42ab8caa-1999-4e60-b3db-f46b160cb3f7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:47.253051 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42ab8caa-1999-4e60-b3db-f46b160cb3f7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:47.253752 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42ab8caa-1999-4e60-b3db-f46b160cb3f7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:47.254843 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42ab8caa-1999-4e60-b3db-f46b160cb3f7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:47.255439 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42ab8caa-1999-4e60-b3db-f46b160cb3f7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:47.437046 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-42ab8caa-1999-4e60-b3db-f46b160cb3f7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:47.444227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:47.467787 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-42ab8caa-1999-4e60-b3db-f46b160cb3f7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.234105 Jun 29 11:25:47.472656 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 85/184] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:47 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:47.807031 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-62cd895d-2f41-48e6-98da-19f671d21c6c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:47.807647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-62cd895d-2f41-48e6-98da-19f671d21c6c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:47.813999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-62cd895d-2f41-48e6-98da-19f671d21c6c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:47.814438 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-62cd895d-2f41-48e6-98da-19f671d21c6c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:47.815192 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-62cd895d-2f41-48e6-98da-19f671d21c6c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:47.815612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-62cd895d-2f41-48e6-98da-19f671d21c6c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:47.975122 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-62cd895d-2f41-48e6-98da-19f671d21c6c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:47.984856 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-62cd895d-2f41-48e6-98da-19f671d21c6c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.182223 Jun 29 11:25:47.985424 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 100/185] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:47 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:48.503420 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b209f34b-1f19-45a0-8dd9-da66d8de95f8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:48.506191 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b209f34b-1f19-45a0-8dd9-da66d8de95f8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:48.526625 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b209f34b-1f19-45a0-8dd9-da66d8de95f8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:48.527077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b209f34b-1f19-45a0-8dd9-da66d8de95f8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:48.532100 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b209f34b-1f19-45a0-8dd9-da66d8de95f8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:48.532474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b209f34b-1f19-45a0-8dd9-da66d8de95f8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:48.852920 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b209f34b-1f19-45a0-8dd9-da66d8de95f8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:48.862875 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b209f34b-1f19-45a0-8dd9-da66d8de95f8 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1313 microversion: 2.1 time: 0.377088 Jun 29 11:25:48.863459 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 86/186] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:48 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:49.002725 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6552f1c3-1c49-4f2e-acf4-36d4e0101d55 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:49.003340 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6552f1c3-1c49-4f2e-acf4-36d4e0101d55 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:49.012227 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6552f1c3-1c49-4f2e-acf4-36d4e0101d55 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:49.012680 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6552f1c3-1c49-4f2e-acf4-36d4e0101d55 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:49.013454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6552f1c3-1c49-4f2e-acf4-36d4e0101d55 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:49.013888 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6552f1c3-1c49-4f2e-acf4-36d4e0101d55 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:49.233727 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6552f1c3-1c49-4f2e-acf4-36d4e0101d55 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:49.242842 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6552f1c3-1c49-4f2e-acf4-36d4e0101d55 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.244165 Jun 29 11:25:49.243887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 101/187] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:48 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:49.881132 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-756b4269-0d14-4bd9-a0fe-cd098c940f4a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:49.881819 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-756b4269-0d14-4bd9-a0fe-cd098c940f4a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:49.887796 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-756b4269-0d14-4bd9-a0fe-cd098c940f4a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:49.888497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-756b4269-0d14-4bd9-a0fe-cd098c940f4a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:49.889888 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-756b4269-0d14-4bd9-a0fe-cd098c940f4a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:49.890317 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-756b4269-0d14-4bd9-a0fe-cd098c940f4a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:50.077957 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-756b4269-0d14-4bd9-a0fe-cd098c940f4a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:50.087110 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-756b4269-0d14-4bd9-a0fe-cd098c940f4a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1500 microversion: 2.1 time: 0.209878 Jun 29 11:25:50.087674 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 87/188] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:49 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1500 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:50.260396 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7685bf9d-2a5f-4a81-a83b-d658fa1d1c96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:50.262192 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7685bf9d-2a5f-4a81-a83b-d658fa1d1c96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:50.286759 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7685bf9d-2a5f-4a81-a83b-d658fa1d1c96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:50.287715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7685bf9d-2a5f-4a81-a83b-d658fa1d1c96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:50.288862 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7685bf9d-2a5f-4a81-a83b-d658fa1d1c96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:50.295381 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7685bf9d-2a5f-4a81-a83b-d658fa1d1c96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:50.451542 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7685bf9d-2a5f-4a81-a83b-d658fa1d1c96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:50.460665 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7685bf9d-2a5f-4a81-a83b-d658fa1d1c96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.204854 Jun 29 11:25:50.461767 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 102/189] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:50 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:51.478393 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-40edbdb8-798f-45d9-a8a5-e5997432d942 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:51.478982 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-40edbdb8-798f-45d9-a8a5-e5997432d942 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:51.485437 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40edbdb8-798f-45d9-a8a5-e5997432d942 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:51.485951 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40edbdb8-798f-45d9-a8a5-e5997432d942 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:51.487383 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40edbdb8-798f-45d9-a8a5-e5997432d942 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:51.487815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40edbdb8-798f-45d9-a8a5-e5997432d942 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:51.616843 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-40edbdb8-798f-45d9-a8a5-e5997432d942 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:51.624860 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-40edbdb8-798f-45d9-a8a5-e5997432d942 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.150923 Jun 29 11:25:51.625424 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 88/190] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:51 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:52.228418 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f53c1cb0-f6cc-4495-b1c2-3f43a481550a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6ba78f5-2c7b-4d37-b3c9-b4d4c0d6f6e9"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:25:52.229457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f53c1cb0-f6cc-4495-b1c2-3f43a481550a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:52.235594 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f53c1cb0-f6cc-4495-b1c2-3f43a481550a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:52.236166 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f53c1cb0-f6cc-4495-b1c2-3f43a481550a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:52.236945 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f53c1cb0-f6cc-4495-b1c2-3f43a481550a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:52.237363 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f53c1cb0-f6cc-4495-b1c2-3f43a481550a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:52.297966 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:52.641449 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9209fe07-106e-4f4d-9eb3-fe2c7b3ed73f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:52.642047 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9209fe07-106e-4f4d-9eb3-fe2c7b3ed73f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:52.648015 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9209fe07-106e-4f4d-9eb3-fe2c7b3ed73f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:52.648459 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9209fe07-106e-4f4d-9eb3-fe2c7b3ed73f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:52.649709 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9209fe07-106e-4f4d-9eb3-fe2c7b3ed73f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:52.650137 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9209fe07-106e-4f4d-9eb3-fe2c7b3ed73f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:52.794573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9209fe07-106e-4f4d-9eb3-fe2c7b3ed73f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:52.803064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9209fe07-106e-4f4d-9eb3-fe2c7b3ed73f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.165395 Jun 29 11:25:52.807506 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 89/191] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:52 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:53.819404 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dd0b6cfe-f50d-4414-a0a3-93fe8103bb4a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:53.820044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dd0b6cfe-f50d-4414-a0a3-93fe8103bb4a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:53.826173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd0b6cfe-f50d-4414-a0a3-93fe8103bb4a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:53.826627 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd0b6cfe-f50d-4414-a0a3-93fe8103bb4a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:53.827379 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd0b6cfe-f50d-4414-a0a3-93fe8103bb4a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:53.827813 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd0b6cfe-f50d-4414-a0a3-93fe8103bb4a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:53.960176 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dd0b6cfe-f50d-4414-a0a3-93fe8103bb4a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:53.968043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dd0b6cfe-f50d-4414-a0a3-93fe8103bb4a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.152411 Jun 29 11:25:53.968608 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 90/192] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:53 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:54.985523 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0f4a3bed-db0d-4a83-8d48-77ecd2d403e4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:54.986109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0f4a3bed-db0d-4a83-8d48-77ecd2d403e4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:54.992136 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f4a3bed-db0d-4a83-8d48-77ecd2d403e4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:54.992573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f4a3bed-db0d-4a83-8d48-77ecd2d403e4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:54.993318 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f4a3bed-db0d-4a83-8d48-77ecd2d403e4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:54.994231 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f4a3bed-db0d-4a83-8d48-77ecd2d403e4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:55.121029 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0f4a3bed-db0d-4a83-8d48-77ecd2d403e4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:55.128384 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0f4a3bed-db0d-4a83-8d48-77ecd2d403e4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.146719 Jun 29 11:25:55.128956 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 91/193] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:54 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:56.144385 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fb0b5579-23fd-4aef-aca1-e16af344497d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:56.144999 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fb0b5579-23fd-4aef-aca1-e16af344497d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:56.150846 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb0b5579-23fd-4aef-aca1-e16af344497d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:56.151288 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb0b5579-23fd-4aef-aca1-e16af344497d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:56.152093 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb0b5579-23fd-4aef-aca1-e16af344497d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:56.152509 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb0b5579-23fd-4aef-aca1-e16af344497d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:56.281009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fb0b5579-23fd-4aef-aca1-e16af344497d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:56.288601 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fb0b5579-23fd-4aef-aca1-e16af344497d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.148179 Jun 29 11:25:56.289167 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 92/194] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:56 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:25:56.718314 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f53c1cb0-f6cc-4495-b1c2-3f43a481550a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "POST /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.494404 Jun 29 11:25:56.719579 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 103/195] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:25:52 2022] POST /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864/os-volume_attachments => generated 194 bytes in 4497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:25:57.305531 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d0a71501-d2ad-4c9a-bc65-9c340c16606a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:57.306050 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d0a71501-d2ad-4c9a-bc65-9c340c16606a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:57.312000 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d0a71501-d2ad-4c9a-bc65-9c340c16606a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:57.312442 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d0a71501-d2ad-4c9a-bc65-9c340c16606a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:57.313200 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d0a71501-d2ad-4c9a-bc65-9c340c16606a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:57.313631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d0a71501-d2ad-4c9a-bc65-9c340c16606a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:57.440417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d0a71501-d2ad-4c9a-bc65-9c340c16606a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:57.448339 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d0a71501-d2ad-4c9a-bc65-9c340c16606a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.146909 Jun 29 11:25:57.448909 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 93/196] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:57 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:58.466160 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-278da283-51cf-430a-adb6-5c173d570367 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:58.466852 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-278da283-51cf-430a-adb6-5c173d570367 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:58.473890 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-278da283-51cf-430a-adb6-5c173d570367 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:58.474332 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-278da283-51cf-430a-adb6-5c173d570367 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:58.475079 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-278da283-51cf-430a-adb6-5c173d570367 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:58.475658 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-278da283-51cf-430a-adb6-5c173d570367 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:58.609066 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-278da283-51cf-430a-adb6-5c173d570367 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:58.616912 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-278da283-51cf-430a-adb6-5c173d570367 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.155553 Jun 29 11:25:58.617467 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 104/197] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:58 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:25:59.632621 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-87dedc12-16d8-4b61-b29c-e8dae1ce651e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:25:59.633215 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-87dedc12-16d8-4b61-b29c-e8dae1ce651e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:25:59.639154 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-87dedc12-16d8-4b61-b29c-e8dae1ce651e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:59.639597 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-87dedc12-16d8-4b61-b29c-e8dae1ce651e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:59.640379 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-87dedc12-16d8-4b61-b29c-e8dae1ce651e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:25:59.640806 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-87dedc12-16d8-4b61-b29c-e8dae1ce651e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:25:59.772347 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-87dedc12-16d8-4b61-b29c-e8dae1ce651e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:25:59.779802 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-87dedc12-16d8-4b61-b29c-e8dae1ce651e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.150999 Jun 29 11:25:59.780392 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 94/198] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:25:59 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:00.795741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b1097370-d912-4677-bf0b-3c09d96018f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:00.796271 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b1097370-d912-4677-bf0b-3c09d96018f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:00.802582 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1097370-d912-4677-bf0b-3c09d96018f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:00.803060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1097370-d912-4677-bf0b-3c09d96018f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:00.803813 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1097370-d912-4677-bf0b-3c09d96018f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:00.804276 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1097370-d912-4677-bf0b-3c09d96018f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:00.949419 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b1097370-d912-4677-bf0b-3c09d96018f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:00.956929 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b1097370-d912-4677-bf0b-3c09d96018f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.165063 Jun 29 11:26:00.957487 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 105/199] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:00 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:01.973673 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-792ef83e-56ed-4347-a05d-07bb68de70ed tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:01.974271 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-792ef83e-56ed-4347-a05d-07bb68de70ed tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:01.980063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-792ef83e-56ed-4347-a05d-07bb68de70ed tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:01.980526 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-792ef83e-56ed-4347-a05d-07bb68de70ed tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:01.981266 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-792ef83e-56ed-4347-a05d-07bb68de70ed tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:01.981708 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-792ef83e-56ed-4347-a05d-07bb68de70ed tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:02.115281 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-792ef83e-56ed-4347-a05d-07bb68de70ed tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:02.123276 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-792ef83e-56ed-4347-a05d-07bb68de70ed tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.153389 Jun 29 11:26:02.123850 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 95/200] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:01 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:03.140569 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b66ef7a4-7542-414b-81ef-43dfa83545b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:03.141170 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b66ef7a4-7542-414b-81ef-43dfa83545b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:03.147533 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b66ef7a4-7542-414b-81ef-43dfa83545b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:03.148008 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b66ef7a4-7542-414b-81ef-43dfa83545b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:03.148751 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b66ef7a4-7542-414b-81ef-43dfa83545b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:03.149177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b66ef7a4-7542-414b-81ef-43dfa83545b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:03.275133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b66ef7a4-7542-414b-81ef-43dfa83545b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:03.282575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b66ef7a4-7542-414b-81ef-43dfa83545b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.145825 Jun 29 11:26:03.283249 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 106/201] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:03 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:04.298933 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-76449640-ea5d-4248-8795-86645a37429e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:04.299530 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-76449640-ea5d-4248-8795-86645a37429e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:04.301548 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=52 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:26:04.306849 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-76449640-ea5d-4248-8795-86645a37429e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:04.313700 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-76449640-ea5d-4248-8795-86645a37429e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:04.313700 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-76449640-ea5d-4248-8795-86645a37429e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:04.313700 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-76449640-ea5d-4248-8795-86645a37429e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:04.434375 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-76449640-ea5d-4248-8795-86645a37429e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:04.441657 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-76449640-ea5d-4248-8795-86645a37429e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.146516 Jun 29 11:26:04.442224 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 96/202] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:04 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:05.458426 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d93ce61d-347e-49ba-bba7-944b71660a4c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:05.459029 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d93ce61d-347e-49ba-bba7-944b71660a4c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:05.465558 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d93ce61d-347e-49ba-bba7-944b71660a4c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:05.465998 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d93ce61d-347e-49ba-bba7-944b71660a4c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:05.466737 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d93ce61d-347e-49ba-bba7-944b71660a4c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:05.467161 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d93ce61d-347e-49ba-bba7-944b71660a4c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:05.594178 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d93ce61d-347e-49ba-bba7-944b71660a4c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:05.602091 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d93ce61d-347e-49ba-bba7-944b71660a4c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.147408 Jun 29 11:26:05.602605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 107/203] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:05 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:06.619528 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c2aa2ffe-762b-4ac2-af6f-fb251e353cf3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:06.620160 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c2aa2ffe-762b-4ac2-af6f-fb251e353cf3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:06.626189 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2aa2ffe-762b-4ac2-af6f-fb251e353cf3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:06.626631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2aa2ffe-762b-4ac2-af6f-fb251e353cf3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:06.627383 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2aa2ffe-762b-4ac2-af6f-fb251e353cf3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:06.627817 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2aa2ffe-762b-4ac2-af6f-fb251e353cf3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:06.758754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c2aa2ffe-762b-4ac2-af6f-fb251e353cf3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:06.766891 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c2aa2ffe-762b-4ac2-af6f-fb251e353cf3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.151655 Jun 29 11:26:06.767570 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 97/204] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:06 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:07.784702 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f9ccbaa0-3920-4621-ab1a-b0efb5fad0b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:07.785302 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f9ccbaa0-3920-4621-ab1a-b0efb5fad0b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:07.791710 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9ccbaa0-3920-4621-ab1a-b0efb5fad0b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:07.792177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9ccbaa0-3920-4621-ab1a-b0efb5fad0b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:07.792925 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9ccbaa0-3920-4621-ab1a-b0efb5fad0b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:07.793348 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9ccbaa0-3920-4621-ab1a-b0efb5fad0b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:07.920681 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f9ccbaa0-3920-4621-ab1a-b0efb5fad0b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:07.928179 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f9ccbaa0-3920-4621-ab1a-b0efb5fad0b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.147251 Jun 29 11:26:07.928735 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 108/205] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:07 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:08.944800 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8724278b-0853-469c-9295-2176939016c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:08.945400 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8724278b-0853-469c-9295-2176939016c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:08.951320 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8724278b-0853-469c-9295-2176939016c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:08.951761 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8724278b-0853-469c-9295-2176939016c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:08.952559 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8724278b-0853-469c-9295-2176939016c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:08.952992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8724278b-0853-469c-9295-2176939016c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:09.080010 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8724278b-0853-469c-9295-2176939016c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:09.087916 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8724278b-0853-469c-9295-2176939016c1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.146297 Jun 29 11:26:09.088487 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 98/206] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:08 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:10.104870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-174f5242-e140-424b-a31b-45b4322ca328 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:10.105470 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-174f5242-e140-424b-a31b-45b4322ca328 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:10.111948 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-174f5242-e140-424b-a31b-45b4322ca328 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:10.112387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-174f5242-e140-424b-a31b-45b4322ca328 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:10.113128 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-174f5242-e140-424b-a31b-45b4322ca328 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:10.113554 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-174f5242-e140-424b-a31b-45b4322ca328 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:10.239665 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-174f5242-e140-424b-a31b-45b4322ca328 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:10.246974 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-174f5242-e140-424b-a31b-45b4322ca328 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.145966 Jun 29 11:26:10.247529 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 109/207] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:10 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:11.263366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-446c6a71-4427-43ea-a123-66f24a86c03d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:11.264008 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-446c6a71-4427-43ea-a123-66f24a86c03d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:11.270061 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-446c6a71-4427-43ea-a123-66f24a86c03d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:11.272130 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-446c6a71-4427-43ea-a123-66f24a86c03d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:11.272130 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-446c6a71-4427-43ea-a123-66f24a86c03d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:11.272130 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-446c6a71-4427-43ea-a123-66f24a86c03d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:11.405468 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-446c6a71-4427-43ea-a123-66f24a86c03d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:11.412804 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-446c6a71-4427-43ea-a123-66f24a86c03d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.153290 Jun 29 11:26:11.414871 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 99/208] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:11 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:12.429998 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-582ad6bf-5913-49dc-a690-9ed897e3e948 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:12.430608 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-582ad6bf-5913-49dc-a690-9ed897e3e948 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:12.437591 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-582ad6bf-5913-49dc-a690-9ed897e3e948 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:12.438039 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-582ad6bf-5913-49dc-a690-9ed897e3e948 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:12.438789 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-582ad6bf-5913-49dc-a690-9ed897e3e948 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:12.439225 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-582ad6bf-5913-49dc-a690-9ed897e3e948 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:12.566133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-582ad6bf-5913-49dc-a690-9ed897e3e948 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:12.573515 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-582ad6bf-5913-49dc-a690-9ed897e3e948 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.147319 Jun 29 11:26:12.574075 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 110/209] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:12 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:13.589885 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-24a61865-29ca-4316-aa6d-1b04f47520b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:13.590565 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-24a61865-29ca-4316-aa6d-1b04f47520b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:13.596727 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24a61865-29ca-4316-aa6d-1b04f47520b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:13.597163 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24a61865-29ca-4316-aa6d-1b04f47520b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:13.597904 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24a61865-29ca-4316-aa6d-1b04f47520b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:13.598332 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24a61865-29ca-4316-aa6d-1b04f47520b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:13.723641 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-24a61865-29ca-4316-aa6d-1b04f47520b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:13.731668 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-24a61865-29ca-4316-aa6d-1b04f47520b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.145566 Jun 29 11:26:13.732260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 100/210] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:13 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:14.748123 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c6bf23ea-edb1-4e57-af40-5d1e2bef2902 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:14.748763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c6bf23ea-edb1-4e57-af40-5d1e2bef2902 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:14.754987 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6bf23ea-edb1-4e57-af40-5d1e2bef2902 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:14.755437 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6bf23ea-edb1-4e57-af40-5d1e2bef2902 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:14.756214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6bf23ea-edb1-4e57-af40-5d1e2bef2902 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:14.756649 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6bf23ea-edb1-4e57-af40-5d1e2bef2902 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:14.885764 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c6bf23ea-edb1-4e57-af40-5d1e2bef2902 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:14.893075 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c6bf23ea-edb1-4e57-af40-5d1e2bef2902 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.148765 Jun 29 11:26:14.893648 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 111/211] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:14 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:15.909621 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2573fb20-9038-46b7-8a5f-e37b09943437 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:15.910237 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2573fb20-9038-46b7-8a5f-e37b09943437 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:15.917005 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2573fb20-9038-46b7-8a5f-e37b09943437 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:15.922773 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2573fb20-9038-46b7-8a5f-e37b09943437 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:15.922773 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2573fb20-9038-46b7-8a5f-e37b09943437 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:15.922773 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2573fb20-9038-46b7-8a5f-e37b09943437 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:16.048089 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2573fb20-9038-46b7-8a5f-e37b09943437 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:16.055469 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2573fb20-9038-46b7-8a5f-e37b09943437 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.149687 Jun 29 11:26:16.056084 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 101/212] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:15 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:17.073060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1b108231-99a5-4842-bbe7-e3cebfa5bb0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:17.073675 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1b108231-99a5-4842-bbe7-e3cebfa5bb0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:17.076218 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=26 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:26:17.080849 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b108231-99a5-4842-bbe7-e3cebfa5bb0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:17.081286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b108231-99a5-4842-bbe7-e3cebfa5bb0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:17.082054 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b108231-99a5-4842-bbe7-e3cebfa5bb0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:17.082475 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b108231-99a5-4842-bbe7-e3cebfa5bb0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:17.215085 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1b108231-99a5-4842-bbe7-e3cebfa5bb0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:17.221860 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1b108231-99a5-4842-bbe7-e3cebfa5bb0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.153449 Jun 29 11:26:17.222420 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 112/213] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:17 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:18.238471 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d256b3ac-8811-4a27-a6f5-1da6e876c4bb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:18.239122 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d256b3ac-8811-4a27-a6f5-1da6e876c4bb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:18.245225 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d256b3ac-8811-4a27-a6f5-1da6e876c4bb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:18.245670 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d256b3ac-8811-4a27-a6f5-1da6e876c4bb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:18.246415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d256b3ac-8811-4a27-a6f5-1da6e876c4bb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:18.246890 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d256b3ac-8811-4a27-a6f5-1da6e876c4bb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:18.266315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:26:18.380749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d256b3ac-8811-4a27-a6f5-1da6e876c4bb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:18.388947 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d256b3ac-8811-4a27-a6f5-1da6e876c4bb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.154395 Jun 29 11:26:18.389575 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 102/214] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:18 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:19.405588 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0e945d3a-72f4-40d4-86e3-0fe97b351b9d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:19.406233 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0e945d3a-72f4-40d4-86e3-0fe97b351b9d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:19.413151 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e945d3a-72f4-40d4-86e3-0fe97b351b9d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:19.416795 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e945d3a-72f4-40d4-86e3-0fe97b351b9d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:19.416795 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e945d3a-72f4-40d4-86e3-0fe97b351b9d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:19.416795 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e945d3a-72f4-40d4-86e3-0fe97b351b9d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:19.559331 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0e945d3a-72f4-40d4-86e3-0fe97b351b9d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:19.567116 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0e945d3a-72f4-40d4-86e3-0fe97b351b9d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.165322 Jun 29 11:26:19.568099 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 113/215] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:19 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:20.583923 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b2534c18-43b2-48b3-bb81-0c2d6ff47195 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:20.585103 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b2534c18-43b2-48b3-bb81-0c2d6ff47195 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:20.591162 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2534c18-43b2-48b3-bb81-0c2d6ff47195 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:20.591604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2534c18-43b2-48b3-bb81-0c2d6ff47195 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:20.598769 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2534c18-43b2-48b3-bb81-0c2d6ff47195 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:20.598769 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2534c18-43b2-48b3-bb81-0c2d6ff47195 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:20.766923 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b2534c18-43b2-48b3-bb81-0c2d6ff47195 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:20.783324 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b2534c18-43b2-48b3-bb81-0c2d6ff47195 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.202064 Jun 29 11:26:20.785056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 103/216] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:20 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:21.803451 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-160f1304-4a0e-4fe1-a1b8-e38c455fdfe1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:21.805309 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-160f1304-4a0e-4fe1-a1b8-e38c455fdfe1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:21.813367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-160f1304-4a0e-4fe1-a1b8-e38c455fdfe1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:21.813811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-160f1304-4a0e-4fe1-a1b8-e38c455fdfe1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:21.819563 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-160f1304-4a0e-4fe1-a1b8-e38c455fdfe1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:21.820280 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-160f1304-4a0e-4fe1-a1b8-e38c455fdfe1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:21.986852 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-160f1304-4a0e-4fe1-a1b8-e38c455fdfe1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:21.994800 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-160f1304-4a0e-4fe1-a1b8-e38c455fdfe1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.197431 Jun 29 11:26:21.995359 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 114/217] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:21 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:23.012616 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4876dbb8-d66a-4f83-be3a-04f37b398c8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:23.013308 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4876dbb8-d66a-4f83-be3a-04f37b398c8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:23.019481 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4876dbb8-d66a-4f83-be3a-04f37b398c8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:23.022099 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4876dbb8-d66a-4f83-be3a-04f37b398c8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:23.022099 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4876dbb8-d66a-4f83-be3a-04f37b398c8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:23.022099 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4876dbb8-d66a-4f83-be3a-04f37b398c8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:23.159351 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4876dbb8-d66a-4f83-be3a-04f37b398c8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:23.166782 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4876dbb8-d66a-4f83-be3a-04f37b398c8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.158858 Jun 29 11:26:23.167345 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 104/218] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:23 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:24.185686 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-82b77c0f-42f9-49fb-9461-d7af5d4e126a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:24.185686 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-82b77c0f-42f9-49fb-9461-d7af5d4e126a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:24.190671 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82b77c0f-42f9-49fb-9461-d7af5d4e126a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:24.191112 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82b77c0f-42f9-49fb-9461-d7af5d4e126a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:24.191957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82b77c0f-42f9-49fb-9461-d7af5d4e126a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:24.192385 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82b77c0f-42f9-49fb-9461-d7af5d4e126a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:24.194897 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:26:24.336956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-82b77c0f-42f9-49fb-9461-d7af5d4e126a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:24.345287 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-82b77c0f-42f9-49fb-9461-d7af5d4e126a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.165612 Jun 29 11:26:24.345883 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 115/219] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:24 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:25.362595 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f69dd494-06a8-4709-8df7-4eca990ea63c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:25.363180 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f69dd494-06a8-4709-8df7-4eca990ea63c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:25.369569 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f69dd494-06a8-4709-8df7-4eca990ea63c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:25.370040 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f69dd494-06a8-4709-8df7-4eca990ea63c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:25.370800 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f69dd494-06a8-4709-8df7-4eca990ea63c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:25.371228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f69dd494-06a8-4709-8df7-4eca990ea63c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:25.498526 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f69dd494-06a8-4709-8df7-4eca990ea63c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:25.506112 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f69dd494-06a8-4709-8df7-4eca990ea63c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.146992 Jun 29 11:26:25.506687 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 105/220] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:25 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:26.523806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8192876c-3c62-42b9-a327-36e792cd196b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:26.524495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8192876c-3c62-42b9-a327-36e792cd196b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:26.531379 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8192876c-3c62-42b9-a327-36e792cd196b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:26.531824 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8192876c-3c62-42b9-a327-36e792cd196b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:26.532612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8192876c-3c62-42b9-a327-36e792cd196b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:26.533047 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8192876c-3c62-42b9-a327-36e792cd196b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:26.669918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8192876c-3c62-42b9-a327-36e792cd196b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:26.677327 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8192876c-3c62-42b9-a327-36e792cd196b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.157920 Jun 29 11:26:26.686515 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 116/221] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:26 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:27.694016 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-84b3b1a2-3b2b-407a-8a15-585c207659f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:27.694624 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-84b3b1a2-3b2b-407a-8a15-585c207659f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:27.702161 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-84b3b1a2-3b2b-407a-8a15-585c207659f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:27.702161 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-84b3b1a2-3b2b-407a-8a15-585c207659f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:27.702697 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-84b3b1a2-3b2b-407a-8a15-585c207659f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:27.703145 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-84b3b1a2-3b2b-407a-8a15-585c207659f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:27.845018 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-84b3b1a2-3b2b-407a-8a15-585c207659f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:27.852335 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-84b3b1a2-3b2b-407a-8a15-585c207659f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.162198 Jun 29 11:26:27.852897 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 106/222] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:27 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:28.869953 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-64c147e5-1aac-4ef7-ab3e-6de71cfb44f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:28.870841 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-64c147e5-1aac-4ef7-ab3e-6de71cfb44f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:28.878869 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64c147e5-1aac-4ef7-ab3e-6de71cfb44f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:28.879393 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64c147e5-1aac-4ef7-ab3e-6de71cfb44f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:28.880758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64c147e5-1aac-4ef7-ab3e-6de71cfb44f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:28.881252 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64c147e5-1aac-4ef7-ab3e-6de71cfb44f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:29.016613 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-64c147e5-1aac-4ef7-ab3e-6de71cfb44f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:29.024189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-64c147e5-1aac-4ef7-ab3e-6de71cfb44f9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.159235 Jun 29 11:26:29.030704 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 117/223] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:28 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:30.045596 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1967607a-6169-44f8-b84b-00c4286d3a47 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:30.046278 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1967607a-6169-44f8-b84b-00c4286d3a47 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:30.052343 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1967607a-6169-44f8-b84b-00c4286d3a47 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:30.052792 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1967607a-6169-44f8-b84b-00c4286d3a47 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:30.053542 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1967607a-6169-44f8-b84b-00c4286d3a47 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:30.054078 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1967607a-6169-44f8-b84b-00c4286d3a47 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:30.371921 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1967607a-6169-44f8-b84b-00c4286d3a47 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:30.379226 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1967607a-6169-44f8-b84b-00c4286d3a47 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.338120 Jun 29 11:26:30.379788 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 107/224] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:30 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:31.395629 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bfdd0de9-2684-4e03-9a42-bfd62896c8f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:31.396273 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bfdd0de9-2684-4e03-9a42-bfd62896c8f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:31.404181 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfdd0de9-2684-4e03-9a42-bfd62896c8f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:31.404618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfdd0de9-2684-4e03-9a42-bfd62896c8f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:31.405430 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfdd0de9-2684-4e03-9a42-bfd62896c8f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:31.405857 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfdd0de9-2684-4e03-9a42-bfd62896c8f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:31.544323 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bfdd0de9-2684-4e03-9a42-bfd62896c8f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:31.553626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bfdd0de9-2684-4e03-9a42-bfd62896c8f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.161734 Jun 29 11:26:31.554200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 118/225] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:31 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:32.570411 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cdfd2105-1030-4c6f-8339-209529c1059a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:32.571007 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cdfd2105-1030-4c6f-8339-209529c1059a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:32.577339 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdfd2105-1030-4c6f-8339-209529c1059a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:32.577777 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdfd2105-1030-4c6f-8339-209529c1059a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:32.578531 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdfd2105-1030-4c6f-8339-209529c1059a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:32.578953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdfd2105-1030-4c6f-8339-209529c1059a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:32.720903 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cdfd2105-1030-4c6f-8339-209529c1059a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:32.728474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cdfd2105-1030-4c6f-8339-209529c1059a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.162066 Jun 29 11:26:32.729012 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 108/226] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:32 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:33.745541 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bf8ef122-60ad-4282-9c69-666df35de5bc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:33.746182 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bf8ef122-60ad-4282-9c69-666df35de5bc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:33.753101 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf8ef122-60ad-4282-9c69-666df35de5bc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:33.755914 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf8ef122-60ad-4282-9c69-666df35de5bc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:33.755914 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf8ef122-60ad-4282-9c69-666df35de5bc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:33.755914 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf8ef122-60ad-4282-9c69-666df35de5bc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:33.894757 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bf8ef122-60ad-4282-9c69-666df35de5bc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:33.904076 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bf8ef122-60ad-4282-9c69-666df35de5bc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.161000 Jun 29 11:26:33.904720 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 119/227] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:33 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:34.861023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0a1c1548-ab8a-4bc7-a186-f8feed4ff762 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:34.861532 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0a1c1548-ab8a-4bc7-a186-f8feed4ff762 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:34.863407 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=26 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:26:34.868182 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0a1c1548-ab8a-4bc7-a186-f8feed4ff762 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:34.874573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0a1c1548-ab8a-4bc7-a186-f8feed4ff762 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:34.874573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0a1c1548-ab8a-4bc7-a186-f8feed4ff762 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:34.874573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0a1c1548-ab8a-4bc7-a186-f8feed4ff762 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:34.894475 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0a1c1548-ab8a-4bc7-a186-f8feed4ff762 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:26:34.923749 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-47524709-bb4d-4776-bca0-11a5adeb7674 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:34.924588 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-47524709-bb4d-4776-bca0-11a5adeb7674 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:34.930774 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47524709-bb4d-4776-bca0-11a5adeb7674 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:34.931211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47524709-bb4d-4776-bca0-11a5adeb7674 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:34.931986 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47524709-bb4d-4776-bca0-11a5adeb7674 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:34.932535 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47524709-bb4d-4776-bca0-11a5adeb7674 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:35.068443 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-47524709-bb4d-4776-bca0-11a5adeb7674 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:35.076854 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-47524709-bb4d-4776-bca0-11a5adeb7674 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.159780 Jun 29 11:26:35.077430 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 120/228] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:34 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:35.200394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0a1c1548-ab8a-4bc7-a186-f8feed4ff762 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 204 len: 0 microversion: 2.1 time: 0.342368 Jun 29 11:26:35.200950 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 109/229] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:26:34 2022] DELETE /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:26:35.209225 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f718c148-5494-4d40-89c2-569538b6e19e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:35.209857 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f718c148-5494-4d40-89c2-569538b6e19e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:35.216046 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f718c148-5494-4d40-89c2-569538b6e19e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:35.216489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f718c148-5494-4d40-89c2-569538b6e19e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:35.217277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f718c148-5494-4d40-89c2-569538b6e19e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:35.217708 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f718c148-5494-4d40-89c2-569538b6e19e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:35.357925 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f718c148-5494-4d40-89c2-569538b6e19e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:35.366609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f718c148-5494-4d40-89c2-569538b6e19e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1552 microversion: 2.1 time: 0.161415 Jun 29 11:26:35.367399 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 121/230] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:35 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:36.095211 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-12ccbeb9-34de-4a72-9c39-bb8929b6dba9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:36.095958 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-12ccbeb9-34de-4a72-9c39-bb8929b6dba9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:36.101844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12ccbeb9-34de-4a72-9c39-bb8929b6dba9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:36.102839 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12ccbeb9-34de-4a72-9c39-bb8929b6dba9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:36.103020 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12ccbeb9-34de-4a72-9c39-bb8929b6dba9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:36.103453 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12ccbeb9-34de-4a72-9c39-bb8929b6dba9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:36.246585 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-12ccbeb9-34de-4a72-9c39-bb8929b6dba9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:36.255474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-12ccbeb9-34de-4a72-9c39-bb8929b6dba9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.165475 Jun 29 11:26:36.256096 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 110/231] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:36 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:36.385195 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-66b988b7-1b65-4fba-8eee-83bfb744888a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:36.385945 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-66b988b7-1b65-4fba-8eee-83bfb744888a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:36.393335 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66b988b7-1b65-4fba-8eee-83bfb744888a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:36.393821 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66b988b7-1b65-4fba-8eee-83bfb744888a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:36.394582 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66b988b7-1b65-4fba-8eee-83bfb744888a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:36.395025 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-66b988b7-1b65-4fba-8eee-83bfb744888a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:36.537904 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-66b988b7-1b65-4fba-8eee-83bfb744888a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:36.546738 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-66b988b7-1b65-4fba-8eee-83bfb744888a tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1552 microversion: 2.1 time: 0.166362 Jun 29 11:26:36.547316 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 122/232] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:36 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:26:37.272697 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b6ebf3e6-6f2a-45c3-8cc3-74e7ad6b4db5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:37.273546 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b6ebf3e6-6f2a-45c3-8cc3-74e7ad6b4db5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:37.280064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6ebf3e6-6f2a-45c3-8cc3-74e7ad6b4db5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:37.280447 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6ebf3e6-6f2a-45c3-8cc3-74e7ad6b4db5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:37.281198 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6ebf3e6-6f2a-45c3-8cc3-74e7ad6b4db5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:37.281629 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6ebf3e6-6f2a-45c3-8cc3-74e7ad6b4db5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:37.429879 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b6ebf3e6-6f2a-45c3-8cc3-74e7ad6b4db5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:37.454129 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b6ebf3e6-6f2a-45c3-8cc3-74e7ad6b4db5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1522 microversion: 2.1 time: 0.185690 Jun 29 11:26:37.461395 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 111/233] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:37 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:37.565532 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-82c9b9a9-ce81-4f14-a649-999bfcd5d3c7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:37.567129 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-82c9b9a9-ce81-4f14-a649-999bfcd5d3c7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:37.575082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82c9b9a9-ce81-4f14-a649-999bfcd5d3c7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:37.575927 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82c9b9a9-ce81-4f14-a649-999bfcd5d3c7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:37.576891 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82c9b9a9-ce81-4f14-a649-999bfcd5d3c7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:37.577348 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-82c9b9a9-ce81-4f14-a649-999bfcd5d3c7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:37.715061 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-82c9b9a9-ce81-4f14-a649-999bfcd5d3c7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:37.724886 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-82c9b9a9-ce81-4f14-a649-999bfcd5d3c7 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1552 microversion: 2.1 time: 0.164780 Jun 29 11:26:37.725586 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 123/234] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:37 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:38.478140 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-547d9724-2a24-4b68-a017-b99d3cdbe72a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:38.478753 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-547d9724-2a24-4b68-a017-b99d3cdbe72a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:38.486251 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-547d9724-2a24-4b68-a017-b99d3cdbe72a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:38.486761 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-547d9724-2a24-4b68-a017-b99d3cdbe72a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:38.488132 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-547d9724-2a24-4b68-a017-b99d3cdbe72a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:38.488573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-547d9724-2a24-4b68-a017-b99d3cdbe72a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:38.643612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-547d9724-2a24-4b68-a017-b99d3cdbe72a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:38.655184 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-547d9724-2a24-4b68-a017-b99d3cdbe72a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1502 microversion: 2.1 time: 0.182699 Jun 29 11:26:38.656864 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 112/235] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:38 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:38.675625 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-98489ca2-9b09-4837-9865-732b8b071b5e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:38.676551 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-98489ca2-9b09-4837-9865-732b8b071b5e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:38.683138 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98489ca2-9b09-4837-9865-732b8b071b5e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:38.683693 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98489ca2-9b09-4837-9865-732b8b071b5e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:38.684560 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98489ca2-9b09-4837-9865-732b8b071b5e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:38.685722 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98489ca2-9b09-4837-9865-732b8b071b5e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:38.742047 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5ba72f78-2ae3-4f27-9cb6-ddeb593fc4c2 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:38.743268 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5ba72f78-2ae3-4f27-9cb6-ddeb593fc4c2 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:38.750638 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ba72f78-2ae3-4f27-9cb6-ddeb593fc4c2 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:38.754996 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ba72f78-2ae3-4f27-9cb6-ddeb593fc4c2 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:38.754996 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ba72f78-2ae3-4f27-9cb6-ddeb593fc4c2 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:38.754996 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ba72f78-2ae3-4f27-9cb6-ddeb593fc4c2 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:38.962918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-98489ca2-9b09-4837-9865-732b8b071b5e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:38.979222 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-98489ca2-9b09-4837-9865-732b8b071b5e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1516 microversion: 2.1 time: 0.306880 Jun 29 11:26:38.982404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 124/236] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:38 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1516 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:38.999084 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5ba72f78-2ae3-4f27-9cb6-ddeb593fc4c2 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:39.011061 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5ba72f78-2ae3-4f27-9cb6-ddeb593fc4c2 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1552 microversion: 2.1 time: 0.271823 Jun 29 11:26:39.012444 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 113/237] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:38 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1552 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:26:39.394172 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1420433a-33ae-4791-a72e-09ee9c02e56f req-dbd821ab-860b-4e81-99f0-92df37fd224e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864", "name": "network-vif-deleted", "tag": "76b84543-437b-474d-9e8d-b044b0c7d460"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:26:39.402761 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1420433a-33ae-4791-a72e-09ee9c02e56f req-dbd821ab-860b-4e81-99f0-92df37fd224e service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:39.403703 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1420433a-33ae-4791-a72e-09ee9c02e56f req-dbd821ab-860b-4e81-99f0-92df37fd224e service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:39.416582 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1420433a-33ae-4791-a72e-09ee9c02e56f req-dbd821ab-860b-4e81-99f0-92df37fd224e service nova] Creating event network-vif-deleted:76b84543-437b-474d-9e8d-b044b0c7d460 for instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 on hv-cinder-84733 Jun 29 11:26:39.422461 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1420433a-33ae-4791-a72e-09ee9c02e56f req-dbd821ab-860b-4e81-99f0-92df37fd224e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031862 Jun 29 11:26:39.423384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 125/238] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:26:40.028249 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4131b8cc-66dd-46dc-89d3-bbe5882ae6bd tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:40.029452 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4131b8cc-66dd-46dc-89d3-bbe5882ae6bd tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:40.037664 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4131b8cc-66dd-46dc-89d3-bbe5882ae6bd tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:40.038556 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4131b8cc-66dd-46dc-89d3-bbe5882ae6bd tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:40.039953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4131b8cc-66dd-46dc-89d3-bbe5882ae6bd tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:40.040604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4131b8cc-66dd-46dc-89d3-bbe5882ae6bd tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:40.146888 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4131b8cc-66dd-46dc-89d3-bbe5882ae6bd tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:40.157767 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4131b8cc-66dd-46dc-89d3-bbe5882ae6bd tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1344 microversion: 2.1 time: 0.130644 Jun 29 11:26:40.158382 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 114/239] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:40 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:41.179667 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eebe124f-2fa0-4ea3-a2e5-32da42ed5326 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:41.181138 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eebe124f-2fa0-4ea3-a2e5-32da42ed5326 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:41.194053 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eebe124f-2fa0-4ea3-a2e5-32da42ed5326 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:41.194776 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eebe124f-2fa0-4ea3-a2e5-32da42ed5326 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:41.195701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eebe124f-2fa0-4ea3-a2e5-32da42ed5326 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:41.196372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eebe124f-2fa0-4ea3-a2e5-32da42ed5326 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:41.246970 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eebe124f-2fa0-4ea3-a2e5-32da42ed5326 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:41.247368 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eebe124f-2fa0-4ea3-a2e5-32da42ed5326 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:41.252726 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-eebe124f-2fa0-4ea3-a2e5-32da42ed5326 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lazy-loading 'fault' on Instance uuid 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:26:41.299394 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eebe124f-2fa0-4ea3-a2e5-32da42ed5326 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:41.307214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eebe124f-2fa0-4ea3-a2e5-32da42ed5326 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1349 microversion: 2.1 time: 0.134328 Jun 29 11:26:41.307780 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 126/240] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:41 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1349 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:42.324599 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-529aea18-6b2c-48f2-8849-5240c7573e98 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:42.325111 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-529aea18-6b2c-48f2-8849-5240c7573e98 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:42.331230 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-529aea18-6b2c-48f2-8849-5240c7573e98 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:42.331682 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-529aea18-6b2c-48f2-8849-5240c7573e98 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:42.332482 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-529aea18-6b2c-48f2-8849-5240c7573e98 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:42.332917 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-529aea18-6b2c-48f2-8849-5240c7573e98 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:42.364455 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-529aea18-6b2c-48f2-8849-5240c7573e98 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:42.364906 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-529aea18-6b2c-48f2-8849-5240c7573e98 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:42.365349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-529aea18-6b2c-48f2-8849-5240c7573e98 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lazy-loading 'fault' on Instance uuid 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:26:42.419271 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-529aea18-6b2c-48f2-8849-5240c7573e98 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:42.427912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-529aea18-6b2c-48f2-8849-5240c7573e98 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1349 microversion: 2.1 time: 0.107212 Jun 29 11:26:42.431965 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 115/241] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:42 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1349 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:43.444983 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bd91e278-469a-4bee-9a2e-95cb99128a4e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:43.445691 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd91e278-469a-4bee-9a2e-95cb99128a4e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:43.453673 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd91e278-469a-4bee-9a2e-95cb99128a4e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:43.454124 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd91e278-469a-4bee-9a2e-95cb99128a4e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:43.455024 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd91e278-469a-4bee-9a2e-95cb99128a4e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:43.455462 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd91e278-469a-4bee-9a2e-95cb99128a4e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:43.488076 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd91e278-469a-4bee-9a2e-95cb99128a4e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:43.488517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd91e278-469a-4bee-9a2e-95cb99128a4e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:43.489751 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-bd91e278-469a-4bee-9a2e-95cb99128a4e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lazy-loading 'fault' on Instance uuid 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:26:43.531920 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd91e278-469a-4bee-9a2e-95cb99128a4e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:43.539712 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bd91e278-469a-4bee-9a2e-95cb99128a4e tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1349 microversion: 2.1 time: 0.098559 Jun 29 11:26:43.540528 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 127/242] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:43 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:44.556473 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-95cb753f-8745-41bb-a6c9-b956bda6a9bb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:44.557078 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-95cb753f-8745-41bb-a6c9-b956bda6a9bb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:44.563128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95cb753f-8745-41bb-a6c9-b956bda6a9bb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:44.563570 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95cb753f-8745-41bb-a6c9-b956bda6a9bb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:44.564339 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95cb753f-8745-41bb-a6c9-b956bda6a9bb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:44.564767 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95cb753f-8745-41bb-a6c9-b956bda6a9bb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:44.596125 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95cb753f-8745-41bb-a6c9-b956bda6a9bb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:44.596568 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95cb753f-8745-41bb-a6c9-b956bda6a9bb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:44.597162 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-95cb753f-8745-41bb-a6c9-b956bda6a9bb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lazy-loading 'fault' on Instance uuid 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:26:44.636068 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-95cb753f-8745-41bb-a6c9-b956bda6a9bb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ca7ff32b434abc8d036ddfa266a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07bc0c697e63498799ecf2a0335eae46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:44.640171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:26:44.644851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-95cb753f-8745-41bb-a6c9-b956bda6a9bb tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 200 len: 1349 microversion: 2.1 time: 0.092331 Jun 29 11:26:44.645407 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 116/243] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:44 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:45.662291 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce698de1-a463-455c-a673-3d401ea31bd5 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:45.662894 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce698de1-a463-455c-a673-3d401ea31bd5 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:45.670331 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce698de1-a463-455c-a673-3d401ea31bd5 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:45.670722 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce698de1-a463-455c-a673-3d401ea31bd5 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:45.671485 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce698de1-a463-455c-a673-3d401ea31bd5 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:45.671959 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce698de1-a463-455c-a673-3d401ea31bd5 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:45.689604 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-ce698de1-a463-455c-a673-3d401ea31bd5 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] HTTP exception thrown: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce698de1-a463-455c-a673-3d401ea31bd5 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Request method failure captured: Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 HTTP/1.1 Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZ7RGgdRoGNlW_ib6bTBXOM0pDgyOwOrsyB0NOHSFIdFX3SimXjOLdjG51-U-JGpszj74KDgSiT33XRTUeLrBU8GlZbxKW78Q9DIBdgpn4xDwcruW94YHk2jwcvTXNkCnT3yyhWJp4BTOd7oJCkZEwnb13k768U-v2SC_BJWMaikWg Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 07bc0c697e63498799ecf2a0335eae46 Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-DeleteServersTestJSON-1595462558 Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:26:45.694313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:26:45.695758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/07bc0c697e63498799ecf2a0335eae46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_07bc0c697e63498799ecf2a0335eae46", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/07bc0c697e63498799ecf2a0335eae46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/07bc0c697e63498799ecf2a0335eae46"}]}] Jun 29 11:26:45.695758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-DeleteServersTestJSON-1595462558 Jun 29 11:26:45.695758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 07bc0c697e63498799ecf2a0335eae46 Jun 29 11:26:45.695758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1595462558 Jun 29 11:26:45.695758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-DeleteServersTestJSON-1595462558-project Jun 29 11:26:45.695758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:26:45.695758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:26:45.695758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: b1ca7ff32b434abc8d036ddfa266a584 Jun 29 11:26:45.695758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-DeleteServersTestJSON-1595462558-project Jun 29 11:26:45.695758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:26:45.695758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:45.695758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864'} Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:26:45.696605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:45.698064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:26:45.699268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce698de1-a463-455c-a673-3d401ea31bd5 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Returning 404 to user: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:26:45.699268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce698de1-a463-455c-a673-3d401ea31bd5 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 404 len: 111 microversion: 2.1 time: 0.037416 Jun 29 11:26:45.699268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 128/244] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:45 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:26:45.803599 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e3f39d8f-86b3-479d-9c9d-b4ef6207fb36 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:45.804537 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e3f39d8f-86b3-479d-9c9d-b4ef6207fb36 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:45.811526 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3f39d8f-86b3-479d-9c9d-b4ef6207fb36 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:45.811974 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3f39d8f-86b3-479d-9c9d-b4ef6207fb36 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:45.812749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3f39d8f-86b3-479d-9c9d-b4ef6207fb36 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:45.813188 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3f39d8f-86b3-479d-9c9d-b4ef6207fb36 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:45.829500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-e3f39d8f-86b3-479d-9c9d-b4ef6207fb36 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] HTTP exception thrown: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e3f39d8f-86b3-479d-9c9d-b4ef6207fb36 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Request method failure captured: Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864/os-volume_attachments HTTP/1.1 Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDZ7RGgdRoGNlW_ib6bTBXOM0pDgyOwOrsyB0NOHSFIdFX3SimXjOLdjG51-U-JGpszj74KDgSiT33XRTUeLrBU8GlZbxKW78Q9DIBdgpn4xDwcruW94YHk2jwcvTXNkCnT3yyhWJp4BTOd7oJCkZEwnb13k768U-v2SC_BJWMaikWg Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 07bc0c697e63498799ecf2a0335eae46 Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-DeleteServersTestJSON-1595462558 Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:26:45.836739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:26:45.838128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/07bc0c697e63498799ecf2a0335eae46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_07bc0c697e63498799ecf2a0335eae46", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/07bc0c697e63498799ecf2a0335eae46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/07bc0c697e63498799ecf2a0335eae46"}]}] Jun 29 11:26:45.838128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-DeleteServersTestJSON-1595462558 Jun 29 11:26:45.838128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 07bc0c697e63498799ecf2a0335eae46 Jun 29 11:26:45.838128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-DeleteServersTestJSON-1595462558 Jun 29 11:26:45.838128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-DeleteServersTestJSON-1595462558-project Jun 29 11:26:45.838128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:26:45.838128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:26:45.838128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: b1ca7ff32b434abc8d036ddfa266a584 Jun 29 11:26:45.838128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-DeleteServersTestJSON-1595462558-project Jun 29 11:26:45.838128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:26:45.838128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:45.838128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'server_id': '7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864'} Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:26:45.838892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:45.840258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:26:45.842075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e3f39d8f-86b3-479d-9c9d-b4ef6207fb36 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Returning 404 to user: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:26:45.842075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e3f39d8f-86b3-479d-9c9d-b4ef6207fb36 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038601 Jun 29 11:26:45.842075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 117/245] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:26:45 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:26:46.326521 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-385191ac-b7b5-4d15-be84-ae0bbce32947 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:26:46.327633 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-385191ac-b7b5-4d15-be84-ae0bbce32947 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:46.333683 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-385191ac-b7b5-4d15-be84-ae0bbce32947 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:46.334260 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-385191ac-b7b5-4d15-be84-ae0bbce32947 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:46.335087 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-385191ac-b7b5-4d15-be84-ae0bbce32947 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:46.335603 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-385191ac-b7b5-4d15-be84-ae0bbce32947 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:46.362610 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-385191ac-b7b5-4d15-be84-ae0bbce32947 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lazy-loading 'flavor' on Instance uuid f9821f7d-2d75-40ae-b7a1-81bd38b28a26 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:26:46.747005 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-385191ac-b7b5-4d15-be84-ae0bbce32947 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "POST /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26/action" status: 200 len: 32 microversion: 2.1 time: 0.425494 Jun 29 11:26:46.748455 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 129/246] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:26:46 2022] POST /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26/action => generated 32 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 11:26:46.759736 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a524096a-2c66-4445-b27e-1f7fe2d06731 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:46.760667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a524096a-2c66-4445-b27e-1f7fe2d06731 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:46.766910 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a524096a-2c66-4445-b27e-1f7fe2d06731 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:46.767348 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a524096a-2c66-4445-b27e-1f7fe2d06731 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:46.768342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a524096a-2c66-4445-b27e-1f7fe2d06731 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:46.768766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a524096a-2c66-4445-b27e-1f7fe2d06731 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:46.989087 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a524096a-2c66-4445-b27e-1f7fe2d06731 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:46.997643 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a524096a-2c66-4445-b27e-1f7fe2d06731 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.243208 Jun 29 11:26:46.999198 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 118/247] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:46 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:26:48.018458 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c6d0cf33-1a5e-4fc2-8026-336ece30e4c9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:48.021430 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c6d0cf33-1a5e-4fc2-8026-336ece30e4c9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:48.021846 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=40 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:26:48.026818 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6d0cf33-1a5e-4fc2-8026-336ece30e4c9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:48.027269 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6d0cf33-1a5e-4fc2-8026-336ece30e4c9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:48.028186 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6d0cf33-1a5e-4fc2-8026-336ece30e4c9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:48.028620 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6d0cf33-1a5e-4fc2-8026-336ece30e4c9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:48.043676 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:26:48.184738 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c6d0cf33-1a5e-4fc2-8026-336ece30e4c9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:48.195055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c6d0cf33-1a5e-4fc2-8026-336ece30e4c9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.180017 Jun 29 11:26:48.195055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 130/248] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:48 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:48.497008 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cdd365eb-0818-4ed4-9ef0-5f27f14da193 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:48.497526 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cdd365eb-0818-4ed4-9ef0-5f27f14da193 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:48.504324 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdd365eb-0818-4ed4-9ef0-5f27f14da193 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:48.504769 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdd365eb-0818-4ed4-9ef0-5f27f14da193 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:48.505532 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdd365eb-0818-4ed4-9ef0-5f27f14da193 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:48.505958 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cdd365eb-0818-4ed4-9ef0-5f27f14da193 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:48.519270 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-cdd365eb-0818-4ed4-9ef0-5f27f14da193 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] HTTP exception thrown: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cdd365eb-0818-4ed4-9ef0-5f27f14da193 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Request method failure captured: Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 HTTP/1.1 Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDZ7RGgdRoGNlW_ib6bTBXOM0pDgyOwOrsyB0NOHSFIdFX3SimXjOLdjG51-U-JGpszj74KDgSiT33XRTUeLrBU8GlZbxKW78Q9DIBdgpn4xDwcruW94YHk2jwcvTXNkCnT3yyhWJp4BTOd7oJCkZEwnb13k768U-v2SC_BJWMaikWg Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 07bc0c697e63498799ecf2a0335eae46 Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-DeleteServersTestJSON-1595462558 Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:26:48.521423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:26:48.522867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/07bc0c697e63498799ecf2a0335eae46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_07bc0c697e63498799ecf2a0335eae46", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/07bc0c697e63498799ecf2a0335eae46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/07bc0c697e63498799ecf2a0335eae46"}]}] Jun 29 11:26:48.522867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-DeleteServersTestJSON-1595462558 Jun 29 11:26:48.522867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 07bc0c697e63498799ecf2a0335eae46 Jun 29 11:26:48.522867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-DeleteServersTestJSON-1595462558 Jun 29 11:26:48.522867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-DeleteServersTestJSON-1595462558-project Jun 29 11:26:48.522867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:26:48.522867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:26:48.522867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: b1ca7ff32b434abc8d036ddfa266a584 Jun 29 11:26:48.522867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-DeleteServersTestJSON-1595462558-project Jun 29 11:26:48.522867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:26:48.522867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:48.522867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': '7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864'} Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:26:48.523628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:48.528607 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:26:48.530585 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cdd365eb-0818-4ed4-9ef0-5f27f14da193 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Returning 404 to user: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:26:48.530585 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cdd365eb-0818-4ed4-9ef0-5f27f14da193 tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 404 len: 111 microversion: 2.1 time: 0.030322 Jun 29 11:26:48.530585 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 119/249] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:26:48 2022] DELETE /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:26:48.532152 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-be9a7629-68eb-466e-a493-7b62d0b3629f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:48.532765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-be9a7629-68eb-466e-a493-7b62d0b3629f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] [instance: 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:48.539401 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be9a7629-68eb-466e-a493-7b62d0b3629f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:48.539856 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be9a7629-68eb-466e-a493-7b62d0b3629f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:48.540628 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be9a7629-68eb-466e-a493-7b62d0b3629f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:48.541063 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be9a7629-68eb-466e-a493-7b62d0b3629f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-be9a7629-68eb-466e-a493-7b62d0b3629f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] HTTP exception thrown: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-be9a7629-68eb-466e-a493-7b62d0b3629f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Request method failure captured: Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 HTTP/1.1 Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZ7RGgdRoGNlW_ib6bTBXOM0pDgyOwOrsyB0NOHSFIdFX3SimXjOLdjG51-U-JGpszj74KDgSiT33XRTUeLrBU8GlZbxKW78Q9DIBdgpn4xDwcruW94YHk2jwcvTXNkCnT3yyhWJp4BTOd7oJCkZEwnb13k768U-v2SC_BJWMaikWg Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 07bc0c697e63498799ecf2a0335eae46 Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-DeleteServersTestJSON-1595462558 Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:26:48.577256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:26:48.578457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/07bc0c697e63498799ecf2a0335eae46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_07bc0c697e63498799ecf2a0335eae46", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/07bc0c697e63498799ecf2a0335eae46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/07bc0c697e63498799ecf2a0335eae46"}]}] Jun 29 11:26:48.578457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-DeleteServersTestJSON-1595462558 Jun 29 11:26:48.578457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 07bc0c697e63498799ecf2a0335eae46 Jun 29 11:26:48.578457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1595462558 Jun 29 11:26:48.578457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-DeleteServersTestJSON-1595462558-project Jun 29 11:26:48.578457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:26:48.578457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:26:48.578457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: b1ca7ff32b434abc8d036ddfa266a584 Jun 29 11:26:48.578457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-DeleteServersTestJSON-1595462558-project Jun 29 11:26:48.578457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:26:48.578457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:48.578457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864'} Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:26:48.579094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. Jun 29 11:26:48.580180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:26:48.581201 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-be9a7629-68eb-466e-a493-7b62d0b3629f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] Returning 404 to user: Instance 7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:26:48.581201 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-be9a7629-68eb-466e-a493-7b62d0b3629f tempest-DeleteServersTestJSON-1595462558 tempest-DeleteServersTestJSON-1595462558-project] 10.222.0.44 "GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864" status: 404 len: 111 microversion: 2.1 time: 0.048141 Jun 29 11:26:48.581201 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 131/250] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:48 2022] GET /compute/v2.1/servers/7cfd7f81-2d9a-4ff8-8a34-f0e9b4112864 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 11:26:49.210583 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ea88c6e8-87cc-4b87-8a1c-c8d3aa6c2697 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:49.211670 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ea88c6e8-87cc-4b87-8a1c-c8d3aa6c2697 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:49.221321 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea88c6e8-87cc-4b87-8a1c-c8d3aa6c2697 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:49.221768 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea88c6e8-87cc-4b87-8a1c-c8d3aa6c2697 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:49.222734 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea88c6e8-87cc-4b87-8a1c-c8d3aa6c2697 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:49.223315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea88c6e8-87cc-4b87-8a1c-c8d3aa6c2697 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:49.423079 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ea88c6e8-87cc-4b87-8a1c-c8d3aa6c2697 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:49.433449 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ea88c6e8-87cc-4b87-8a1c-c8d3aa6c2697 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.226660 Jun 29 11:26:49.434040 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 120/251] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:49 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:50.451956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9f68f954-7a36-40af-9948-f0b911986d1c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:50.452659 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9f68f954-7a36-40af-9948-f0b911986d1c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:50.464059 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f68f954-7a36-40af-9948-f0b911986d1c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:50.464628 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f68f954-7a36-40af-9948-f0b911986d1c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:50.465267 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f68f954-7a36-40af-9948-f0b911986d1c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:50.465687 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f68f954-7a36-40af-9948-f0b911986d1c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:50.705981 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9f68f954-7a36-40af-9948-f0b911986d1c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:50.715597 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9f68f954-7a36-40af-9948-f0b911986d1c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.268113 Jun 29 11:26:50.716677 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 132/252] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:50 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:26:51.734016 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a1693e5a-5c85-4ede-8022-7f239a9be866 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:51.734558 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a1693e5a-5c85-4ede-8022-7f239a9be866 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:51.740726 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a1693e5a-5c85-4ede-8022-7f239a9be866 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:51.741185 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a1693e5a-5c85-4ede-8022-7f239a9be866 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:51.741940 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a1693e5a-5c85-4ede-8022-7f239a9be866 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:51.742377 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a1693e5a-5c85-4ede-8022-7f239a9be866 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:51.915315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a1693e5a-5c85-4ede-8022-7f239a9be866 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:51.916901 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a1693e5a-5c85-4ede-8022-7f239a9be866 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.186833 Jun 29 11:26:51.917943 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 121/253] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:51 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:52.935078 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f0036e6c-e3fa-4600-9da6-37e3f545ded9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:52.935688 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f0036e6c-e3fa-4600-9da6-37e3f545ded9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:52.943353 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0036e6c-e3fa-4600-9da6-37e3f545ded9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:52.943800 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0036e6c-e3fa-4600-9da6-37e3f545ded9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:52.944582 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0036e6c-e3fa-4600-9da6-37e3f545ded9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:52.945023 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0036e6c-e3fa-4600-9da6-37e3f545ded9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:53.420113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f0036e6c-e3fa-4600-9da6-37e3f545ded9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:53.427132 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f0036e6c-e3fa-4600-9da6-37e3f545ded9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.495578 Jun 29 11:26:53.437244 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 133/254] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:52 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:54.445496 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e103b4ac-852c-4799-b364-2cabeacde724 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:54.446569 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e103b4ac-852c-4799-b364-2cabeacde724 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:54.466869 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e103b4ac-852c-4799-b364-2cabeacde724 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:54.466869 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e103b4ac-852c-4799-b364-2cabeacde724 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:54.466869 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e103b4ac-852c-4799-b364-2cabeacde724 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:54.467202 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e103b4ac-852c-4799-b364-2cabeacde724 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:54.682360 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e103b4ac-852c-4799-b364-2cabeacde724 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:54.690978 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e103b4ac-852c-4799-b364-2cabeacde724 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.249795 Jun 29 11:26:54.693823 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 122/255] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:54 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:55.716337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c9acbddf-4737-43cc-b77e-455dee2f4323 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:55.718189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c9acbddf-4737-43cc-b77e-455dee2f4323 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:55.726595 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9acbddf-4737-43cc-b77e-455dee2f4323 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:55.727132 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9acbddf-4737-43cc-b77e-455dee2f4323 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:55.728809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9acbddf-4737-43cc-b77e-455dee2f4323 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:55.729550 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9acbddf-4737-43cc-b77e-455dee2f4323 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:55.969659 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c9acbddf-4737-43cc-b77e-455dee2f4323 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:55.988229 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c9acbddf-4737-43cc-b77e-455dee2f4323 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.277649 Jun 29 11:26:55.988883 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 134/256] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:55 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:57.005797 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8b022d41-8c84-4052-b36f-cf4d00c06491 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:57.006433 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8b022d41-8c84-4052-b36f-cf4d00c06491 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:57.012810 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b022d41-8c84-4052-b36f-cf4d00c06491 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:57.013834 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b022d41-8c84-4052-b36f-cf4d00c06491 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:57.015055 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b022d41-8c84-4052-b36f-cf4d00c06491 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:57.015055 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b022d41-8c84-4052-b36f-cf4d00c06491 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:57.248231 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8b022d41-8c84-4052-b36f-cf4d00c06491 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:57.257327 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8b022d41-8c84-4052-b36f-cf4d00c06491 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.255594 Jun 29 11:26:57.258211 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 123/257] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:57 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:58.274608 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fa2fd4c2-04e2-4b26-a71f-cd763451c319 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:58.276067 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fa2fd4c2-04e2-4b26-a71f-cd763451c319 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:58.282944 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa2fd4c2-04e2-4b26-a71f-cd763451c319 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:58.283945 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa2fd4c2-04e2-4b26-a71f-cd763451c319 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:58.285115 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa2fd4c2-04e2-4b26-a71f-cd763451c319 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:58.285842 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa2fd4c2-04e2-4b26-a71f-cd763451c319 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:58.438453 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fa2fd4c2-04e2-4b26-a71f-cd763451c319 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:58.446784 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fa2fd4c2-04e2-4b26-a71f-cd763451c319 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.176344 Jun 29 11:26:58.447357 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 135/258] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:58 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:26:59.465897 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-274f238f-fbce-40e7-81b4-494ca2a64996 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:26:59.467864 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-274f238f-fbce-40e7-81b4-494ca2a64996 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:26:59.476383 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-274f238f-fbce-40e7-81b4-494ca2a64996 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:59.477681 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-274f238f-fbce-40e7-81b4-494ca2a64996 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:59.479736 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-274f238f-fbce-40e7-81b4-494ca2a64996 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:26:59.481335 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-274f238f-fbce-40e7-81b4-494ca2a64996 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:26:59.733201 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-274f238f-fbce-40e7-81b4-494ca2a64996 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:26:59.743396 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-274f238f-fbce-40e7-81b4-494ca2a64996 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.282911 Jun 29 11:26:59.751686 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 124/259] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:26:59 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:00.761082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1ed68fa8-86b9-40fe-bc00-857ea11d8510 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:00.761744 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1ed68fa8-86b9-40fe-bc00-857ea11d8510 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:00.771729 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ed68fa8-86b9-40fe-bc00-857ea11d8510 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:00.772437 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ed68fa8-86b9-40fe-bc00-857ea11d8510 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:00.773411 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ed68fa8-86b9-40fe-bc00-857ea11d8510 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:00.774032 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ed68fa8-86b9-40fe-bc00-857ea11d8510 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:01.076888 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1ed68fa8-86b9-40fe-bc00-857ea11d8510 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:01.087794 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1ed68fa8-86b9-40fe-bc00-857ea11d8510 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.330335 Jun 29 11:27:01.089897 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 136/260] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:00 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:02.105719 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-905e39d5-8ccc-4572-8e64-ff7ff2c5ef96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:02.108120 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-905e39d5-8ccc-4572-8e64-ff7ff2c5ef96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:02.121231 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-905e39d5-8ccc-4572-8e64-ff7ff2c5ef96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:02.127647 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-905e39d5-8ccc-4572-8e64-ff7ff2c5ef96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:02.128685 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-905e39d5-8ccc-4572-8e64-ff7ff2c5ef96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:02.129125 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-905e39d5-8ccc-4572-8e64-ff7ff2c5ef96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:02.366860 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-905e39d5-8ccc-4572-8e64-ff7ff2c5ef96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:02.381368 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-905e39d5-8ccc-4572-8e64-ff7ff2c5ef96 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1502 microversion: 2.1 time: 0.279894 Jun 29 11:27:02.394755 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 125/261] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:02 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1502 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:27:02.401147 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-561dc3cc-476d-4220-985b-1c15068486b9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a0521b3-2436-477f-b89d-ee671bb6aea9"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:02.403508 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-561dc3cc-476d-4220-985b-1c15068486b9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:02.413410 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-561dc3cc-476d-4220-985b-1c15068486b9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:02.413864 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-561dc3cc-476d-4220-985b-1c15068486b9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:02.414632 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-561dc3cc-476d-4220-985b-1c15068486b9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:02.417002 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-561dc3cc-476d-4220-985b-1c15068486b9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:02.456702 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-561dc3cc-476d-4220-985b-1c15068486b9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] HTTP exception thrown: Cannot 'attach_volume' instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 while it is in vm_state rescued Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-561dc3cc-476d-4220-985b-1c15068486b9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Request method failure captured: Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26/os-volume_attachments HTTP/1.1 Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 74 Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZ_hdMYJgq85a0ANpS40L4DnIBMc0L0w2VQmyJptv9vz09vZSHBB5QFP-MIu6lCP_6R2lFejZ1fXBaWqeb2npwIbc3ySbmlrb6USsshKBJfEjko0jZsW2Xjk92OrwImioiZjr5m7Rnec6Fs2oG7eh3N0QRHWm0LQ2lzMoWq-s9mREA Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: cbfba915f70342afb8267e34abc24bfe Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:27:02.458840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:27:02.460391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cbfba915f70342afb8267e34abc24bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cbfba915f70342afb8267e34abc24bfe", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbfba915f70342afb8267e34abc24bfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbfba915f70342afb8267e34abc24bfe"}]}] Jun 29 11:27:02.460391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:27:02.460391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: cbfba915f70342afb8267e34abc24bfe Jun 29 11:27:02.460391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:27:02.460391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-21742587-project Jun 29 11:27:02.460391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:27:02.460391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:27:02.460391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 8effcd6f6be64f14b3c8bc71f8866a99 Jun 29 11:27:02.460391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-21742587-project Jun 29 11:27:02.460391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Jun 29 11:27:02.460391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {"volumeAttachment": {"volumeId": "1a0521b3-2436-477f-b89d-ee671bb6aea9"}} Jun 29 11:27:02.460391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Cannot 'attach_volume' instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 while it is in vm_state rescued Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'server_id': 'f9821f7d-2d75-40ae-b7a1-81bd38b28a26', 'body': {'volumeAttachment': {'volumeId': '1a0521b3-2436-477f-b89d-ee671bb6aea9'}}} Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:27:02.461241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 while it is in vm_state rescued Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:27:02.462544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:27:02.463700 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:27:02.463700 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:27:02.463700 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 while it is in vm_state rescued Jun 29 11:27:02.463700 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:27:02.464807 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-561dc3cc-476d-4220-985b-1c15068486b9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Returning 409 to user: Cannot 'attach_volume' instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 while it is in vm_state rescued {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:27:02.465698 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-561dc3cc-476d-4220-985b-1c15068486b9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "POST /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069108 Jun 29 11:27:02.471338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 137/262] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:27:02 2022] POST /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26/os-volume_attachments => generated 152 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 29 11:27:02.476817 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-475987f0-2835-4ec3-83c1-a585b3c625ec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:02.477531 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-475987f0-2835-4ec3-83c1-a585b3c625ec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:02.484615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-475987f0-2835-4ec3-83c1-a585b3c625ec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:02.485256 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-475987f0-2835-4ec3-83c1-a585b3c625ec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:02.486999 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-475987f0-2835-4ec3-83c1-a585b3c625ec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:02.487303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-475987f0-2835-4ec3-83c1-a585b3c625ec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:02.768958 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-475987f0-2835-4ec3-83c1-a585b3c625ec tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "POST /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26/action" status: 202 len: 0 microversion: 2.1 time: 0.295795 Jun 29 11:27:02.774844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 126/263] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:27:02 2022] POST /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:27:02.789961 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f2e9c12e-2877-4f46-bf7b-17a4c8fa6d5a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:02.790600 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f2e9c12e-2877-4f46-bf7b-17a4c8fa6d5a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:02.802265 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2e9c12e-2877-4f46-bf7b-17a4c8fa6d5a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:02.809784 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2e9c12e-2877-4f46-bf7b-17a4c8fa6d5a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:02.811134 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2e9c12e-2877-4f46-bf7b-17a4c8fa6d5a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:02.812170 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f2e9c12e-2877-4f46-bf7b-17a4c8fa6d5a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:03.111270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f2e9c12e-2877-4f46-bf7b-17a4c8fa6d5a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:03.130865 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f2e9c12e-2877-4f46-bf7b-17a4c8fa6d5a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1510 microversion: 2.1 time: 0.346178 Jun 29 11:27:03.134119 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 138/264] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:02 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:04.161201 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a74d49bc-10ff-4001-9c3f-0ff09cdf7d09 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:04.166606 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a74d49bc-10ff-4001-9c3f-0ff09cdf7d09 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:04.169476 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a74d49bc-10ff-4001-9c3f-0ff09cdf7d09 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:04.169927 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a74d49bc-10ff-4001-9c3f-0ff09cdf7d09 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:04.170707 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a74d49bc-10ff-4001-9c3f-0ff09cdf7d09 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:04.171135 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a74d49bc-10ff-4001-9c3f-0ff09cdf7d09 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:04.332380 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a74d49bc-10ff-4001-9c3f-0ff09cdf7d09 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:04.340423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a74d49bc-10ff-4001-9c3f-0ff09cdf7d09 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1510 microversion: 2.1 time: 0.191867 Jun 29 11:27:04.341807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 127/265] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:04 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:05.334984 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c32cd884-146f-4b26-ba52-c1cacddee44b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Action: 'create', calling method: .version_select at 0x7fd08ab43550>, body: {"keypair": {"name": "tempest-keypair-1667801896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzSap4t+APQIO27ARkjD5jx4VKIDQCmkdY/mdX9gbdhB6lFjeggk5Xg6MOd2tY7+x+C4yKRjtDj8YFoLgtbopDNOzeSFFld8Qm0DHPQNtMTZzNOoWsjC9GtPLPsIs4jYw=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:05.349582 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-c32cd884-146f-4b26-ba52-c1cacddee44b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Getting quotas for project 364a7eaf772c434e9e38a18430425895. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:27:05.354309 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-c32cd884-146f-4b26-ba52-c1cacddee44b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Getting quotas for user 275df17696084dce9e7af487275bacab and project 364a7eaf772c434e9e38a18430425895. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:27:05.361757 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0e5d0b11-9cc9-4e2c-8e56-a85f9f8905f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:05.361757 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0e5d0b11-9cc9-4e2c-8e56-a85f9f8905f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:05.375520 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:05.377390 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e5d0b11-9cc9-4e2c-8e56-a85f9f8905f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:05.380091 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e5d0b11-9cc9-4e2c-8e56-a85f9f8905f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:05.381072 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e5d0b11-9cc9-4e2c-8e56-a85f9f8905f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:05.382961 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e5d0b11-9cc9-4e2c-8e56-a85f9f8905f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:05.452870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c32cd884-146f-4b26-ba52-c1cacddee44b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.243031 Jun 29 11:27:05.453946 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 139/266] 10.222.0.44 () {62 vars in 1199 bytes} [Wed Jun 29 11:27:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 246 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 29 11:27:05.561920 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0e5d0b11-9cc9-4e2c-8e56-a85f9f8905f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:05.571118 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0e5d0b11-9cc9-4e2c-8e56-a85f9f8905f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1510 microversion: 2.1 time: 0.216293 Jun 29 11:27:05.591972 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 128/267] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:05 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:06.604402 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-12e9c1bf-ecce-4554-811d-0200bc9d966b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:06.607953 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-12e9c1bf-ecce-4554-811d-0200bc9d966b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:06.620245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12e9c1bf-ecce-4554-811d-0200bc9d966b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:06.623264 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12e9c1bf-ecce-4554-811d-0200bc9d966b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:06.624135 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12e9c1bf-ecce-4554-811d-0200bc9d966b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:06.625934 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12e9c1bf-ecce-4554-811d-0200bc9d966b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:06.840521 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-12e9c1bf-ecce-4554-811d-0200bc9d966b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:06.856020 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-12e9c1bf-ecce-4554-811d-0200bc9d966b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1510 microversion: 2.1 time: 0.248341 Jun 29 11:27:06.856020 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 140/268] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:06 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:07.865592 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4ec3c123-04d3-4ea4-8eaa-dc9708900e44 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:07.866802 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4ec3c123-04d3-4ea4-8eaa-dc9708900e44 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:07.879604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ec3c123-04d3-4ea4-8eaa-dc9708900e44 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:07.880321 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ec3c123-04d3-4ea4-8eaa-dc9708900e44 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:07.880926 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ec3c123-04d3-4ea4-8eaa-dc9708900e44 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:07.881390 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ec3c123-04d3-4ea4-8eaa-dc9708900e44 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:08.128759 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4ec3c123-04d3-4ea4-8eaa-dc9708900e44 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:08.138724 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4ec3c123-04d3-4ea4-8eaa-dc9708900e44 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1510 microversion: 2.1 time: 0.276402 Jun 29 11:27:08.148832 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 129/269] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:07 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:08.864259 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1514878481", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e08f0a4-ae33-4a05-b770-16cb5680655c"}], "security_groups": [{"name": "tempest-securitygroup--381408979"}], "key_name": "tempest-keypair-1667801896", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:09.024462 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] validate_networks() for [('6e08f0a4-ae33-4a05-b770-16cb5680655c', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:27:09.156688 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f4906d7b-5c2f-4eb9-bc26-8aba0fa501d8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:09.157302 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f4906d7b-5c2f-4eb9-bc26-8aba0fa501d8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:09.175017 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f4906d7b-5c2f-4eb9-bc26-8aba0fa501d8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:09.175478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f4906d7b-5c2f-4eb9-bc26-8aba0fa501d8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:09.177088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f4906d7b-5c2f-4eb9-bc26-8aba0fa501d8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:09.177772 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f4906d7b-5c2f-4eb9-bc26-8aba0fa501d8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:09.360815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f4906d7b-5c2f-4eb9-bc26-8aba0fa501d8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:09.369097 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f4906d7b-5c2f-4eb9-bc26-8aba0fa501d8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1516 microversion: 2.1 time: 0.217136 Jun 29 11:27:09.369635 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 130/270] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:09 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:27:09.846860 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:27:09.847448 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:27:09.848281 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:27:09.848912 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:27:09.849932 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:27:09.863379 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:09.866885 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:09.869006 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:09.869627 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:10.073648 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Getting quotas for project 364a7eaf772c434e9e38a18430425895. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:27:10.078714 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Getting quotas for user 275df17696084dce9e7af487275bacab and project 364a7eaf772c434e9e38a18430425895. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:27:10.092511 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:27:10.096187 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:27:10.360659 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8c2a32d2-121d-444b-bd41-c10f37e5d447 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.500722 Jun 29 11:27:10.365094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 141/271] 10.222.0.44 () {62 vars in 1187 bytes} [Wed Jun 29 11:27:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 29 11:27:10.375971 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-55f1cff6-18fd-4298-a5ca-9dfae4a2369b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:10.377157 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-55f1cff6-18fd-4298-a5ca-9dfae4a2369b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:10.476311 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-55f1cff6-18fd-4298-a5ca-9dfae4a2369b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:10.484502 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-55f1cff6-18fd-4298-a5ca-9dfae4a2369b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:10.486240 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-55f1cff6-18fd-4298-a5ca-9dfae4a2369b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:10.487461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-55f1cff6-18fd-4298-a5ca-9dfae4a2369b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1282 microversion: 2.20 time: 0.116451 Jun 29 11:27:10.488329 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 131/272] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:10 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1282 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:11.506750 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c20c85b6-1870-463e-b9e6-ee0537568269 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:11.510226 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c20c85b6-1870-463e-b9e6-ee0537568269 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:11.583526 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c20c85b6-1870-463e-b9e6-ee0537568269 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:11.591768 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c20c85b6-1870-463e-b9e6-ee0537568269 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:11.593534 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c20c85b6-1870-463e-b9e6-ee0537568269 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:11.605323 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c20c85b6-1870-463e-b9e6-ee0537568269 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1282 microversion: 2.20 time: 0.092957 Jun 29 11:27:11.606967 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 142/273] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:11 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:12.279560 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-979d5685-8732-430a-9de3-57309ef8abc4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Action: 'create', calling method: .version_select at 0x7fd089f8d790>, body: {"keypair": {"name": "tempest-keypair-1584312159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoykG7uKvoP5tqIqyKGIO55R8fuF2ZOowrb0fnugqIuqWDpvr3jPmpLRizpqr06QqM9g24gv/qTQ47Nw++Pmxqm8PwXu1moN0ntSpmHeZ0Cjin6lvyWtJuQNrTI03UkCA=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:12.324959 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-979d5685-8732-430a-9de3-57309ef8abc4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Getting quotas for project cbfba915f70342afb8267e34abc24bfe. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:27:12.330711 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-979d5685-8732-430a-9de3-57309ef8abc4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Getting quotas for user 8effcd6f6be64f14b3c8bc71f8866a99 and project cbfba915f70342afb8267e34abc24bfe. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:27:12.465324 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-979d5685-8732-430a-9de3-57309ef8abc4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.199670 Jun 29 11:27:12.466424 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 132/274] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jun 29 11:27:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:27:12.614634 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26aa5121-9248-492e-b41c-e8b8317064a2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:12.615356 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-26aa5121-9248-492e-b41c-e8b8317064a2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:12.622883 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26aa5121-9248-492e-b41c-e8b8317064a2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:12.623322 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26aa5121-9248-492e-b41c-e8b8317064a2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:12.624102 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26aa5121-9248-492e-b41c-e8b8317064a2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:12.624531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26aa5121-9248-492e-b41c-e8b8317064a2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:12.701995 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-26aa5121-9248-492e-b41c-e8b8317064a2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:12.712089 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-26aa5121-9248-492e-b41c-e8b8317064a2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:12.713619 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-26aa5121-9248-492e-b41c-e8b8317064a2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:12.714728 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-26aa5121-9248-492e-b41c-e8b8317064a2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1334 microversion: 2.20 time: 0.104938 Jun 29 11:27:12.715576 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 143/275] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:12 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1334 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:27:13.746746 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5a812a68-d1c0-4fbb-a6cf-aca874e661a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:13.748299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5a812a68-d1c0-4fbb-a6cf-aca874e661a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:13.754990 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a812a68-d1c0-4fbb-a6cf-aca874e661a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:13.756037 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a812a68-d1c0-4fbb-a6cf-aca874e661a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:13.756462 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a812a68-d1c0-4fbb-a6cf-aca874e661a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:13.756959 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a812a68-d1c0-4fbb-a6cf-aca874e661a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:13.831997 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5a812a68-d1c0-4fbb-a6cf-aca874e661a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:13.840382 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5a812a68-d1c0-4fbb-a6cf-aca874e661a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:13.842801 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5a812a68-d1c0-4fbb-a6cf-aca874e661a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:13.843929 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5a812a68-d1c0-4fbb-a6cf-aca874e661a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1340 microversion: 2.20 time: 0.105735 Jun 29 11:27:13.844806 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 133/276] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:13 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1340 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:14.616555 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1536824471", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:14.685474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] validate_networks() for None {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:27:14.862911 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7913fb11-aa83-4367-8c83-c6cdd923a54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:14.863651 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7913fb11-aa83-4367-8c83-c6cdd923a54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:14.871485 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7913fb11-aa83-4367-8c83-c6cdd923a54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:14.873630 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7913fb11-aa83-4367-8c83-c6cdd923a54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:14.879026 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7913fb11-aa83-4367-8c83-c6cdd923a54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:14.879694 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7913fb11-aa83-4367-8c83-c6cdd923a54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:15.346961 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7913fb11-aa83-4367-8c83-c6cdd923a54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:15.376563 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7913fb11-aa83-4367-8c83-c6cdd923a54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:15.378078 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7913fb11-aa83-4367-8c83-c6cdd923a54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:15.379575 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7913fb11-aa83-4367-8c83-c6cdd923a54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.520675 Jun 29 11:27:15.380698 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 134/277] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:14 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:15.425711 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:27:15.426336 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:27:15.428241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:27:15.429234 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:27:15.431259 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:27:15.441548 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:15.442331 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:15.442814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:15.444015 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:15.464758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Getting quotas for project c7653e362c7d49a3ae386f137c41889c. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:27:15.469037 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Getting quotas for user 907e9be3b1f54f17b8e3841130d41cc7 and project c7653e362c7d49a3ae386f137c41889c. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:27:15.477938 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-118187379", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93470ed8-676b-48ec-9a1b-1a10fe6a5a42"}], "security_groups": [{"name": "tempest-securitygroup--1341659960"}], "key_name": "tempest-keypair-1584312159", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:15.481091 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:27:15.484441 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:27:15.584589 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] validate_networks() for [('93470ed8-676b-48ec-9a1b-1a10fe6a5a42', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:27:15.658746 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-564679a1-3189-4b13-9119-cbc08610f194 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046519 Jun 29 11:27:15.660000 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 144/278] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:27:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:27:15.671609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85810075-4b4a-46ac-9e3a-3fc08fa5137b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:15.673455 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-85810075-4b4a-46ac-9e3a-3fc08fa5137b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:15.770577 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-85810075-4b4a-46ac-9e3a-3fc08fa5137b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:15.776249 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-85810075-4b4a-46ac-9e3a-3fc08fa5137b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1215 microversion: 2.1 time: 0.109694 Jun 29 11:27:15.785376 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 145/279] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:15 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:16.210214 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:27:16.210669 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:27:16.211186 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:27:16.211585 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:27:16.212647 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:27:16.223550 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:16.224042 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:16.224865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:16.225295 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:16.271453 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Getting quotas for project cbfba915f70342afb8267e34abc24bfe. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:27:16.279813 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Getting quotas for user 8effcd6f6be64f14b3c8bc71f8866a99 and project cbfba915f70342afb8267e34abc24bfe. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:27:16.281283 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-ceb63485-4d48-4a9e-b437-64116cf33035 req-da252897-67ed-492a-8e0d-51162dc6dc7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde34fdf-bfe6-48a4-9b9e-95ff879ffa70", "tag": "dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:16.295073 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ceb63485-4d48-4a9e-b437-64116cf33035 req-da252897-67ed-492a-8e0d-51162dc6dc7d service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:16.295520 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ceb63485-4d48-4a9e-b437-64116cf33035 req-da252897-67ed-492a-8e0d-51162dc6dc7d service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:16.305299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:27:16.307604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:27:16.319895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-ceb63485-4d48-4a9e-b437-64116cf33035 req-da252897-67ed-492a-8e0d-51162dc6dc7d service nova] Creating event network-changed:dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48 for instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 on hv-cinder-84733 Jun 29 11:27:16.325932 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-ceb63485-4d48-4a9e-b437-64116cf33035 req-da252897-67ed-492a-8e0d-51162dc6dc7d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054247 Jun 29 11:27:16.326534 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 146/280] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:27:16.400456 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8a01bfa7-7047-432e-976f-12e46acabe64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:16.401542 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8a01bfa7-7047-432e-976f-12e46acabe64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:16.411596 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a01bfa7-7047-432e-976f-12e46acabe64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:16.412119 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a01bfa7-7047-432e-976f-12e46acabe64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:16.413348 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a01bfa7-7047-432e-976f-12e46acabe64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:16.413788 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a01bfa7-7047-432e-976f-12e46acabe64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:16.471210 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-15052af3-4da6-4331-ad4b-8fa61b464a66 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.988549 Jun 29 11:27:16.471210 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 135/281] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:27:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 11:27:16.479121 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-529fa1f5-8b2f-4ff9-9be0-afc988e7c495 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:16.479801 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-529fa1f5-8b2f-4ff9-9be0-afc988e7c495 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:16.627549 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-529fa1f5-8b2f-4ff9-9be0-afc988e7c495 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:16.634764 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-529fa1f5-8b2f-4ff9-9be0-afc988e7c495 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1245 microversion: 2.1 time: 0.162201 Jun 29 11:27:16.635429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 136/282] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:16 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1245 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:16.786780 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a01bfa7-7047-432e-976f-12e46acabe64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:16.796945 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a1ba9dd9-1ef8-4f77-a45d-185a7fdad108 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:16.797634 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a1ba9dd9-1ef8-4f77-a45d-185a7fdad108 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:16.798095 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a01bfa7-7047-432e-976f-12e46acabe64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:16.803007 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a01bfa7-7047-432e-976f-12e46acabe64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:16.804574 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8a01bfa7-7047-432e-976f-12e46acabe64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.410050 Jun 29 11:27:16.805121 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 147/283] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:16 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:17.135487 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a1ba9dd9-1ef8-4f77-a45d-185a7fdad108 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:17.143104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a1ba9dd9-1ef8-4f77-a45d-185a7fdad108 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1215 microversion: 2.1 time: 0.352775 Jun 29 11:27:17.144257 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 137/284] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:16 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1215 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:17.652212 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-de0689c9-422d-4bc6-9759-5585373a913f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:17.652860 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-de0689c9-422d-4bc6-9759-5585373a913f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:17.659524 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de0689c9-422d-4bc6-9759-5585373a913f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:17.660026 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de0689c9-422d-4bc6-9759-5585373a913f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:17.660846 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de0689c9-422d-4bc6-9759-5585373a913f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:17.661454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de0689c9-422d-4bc6-9759-5585373a913f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:17.726750 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-de0689c9-422d-4bc6-9759-5585373a913f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:17.735445 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-de0689c9-422d-4bc6-9759-5585373a913f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1249 microversion: 2.1 time: 0.087275 Jun 29 11:27:17.736275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 148/285] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:17 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:17.825876 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-273e25ab-27c8-4bea-975f-3bbc95de7594 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:17.826484 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-273e25ab-27c8-4bea-975f-3bbc95de7594 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:17.832868 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-273e25ab-27c8-4bea-975f-3bbc95de7594 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:17.835601 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-273e25ab-27c8-4bea-975f-3bbc95de7594 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:17.835601 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-273e25ab-27c8-4bea-975f-3bbc95de7594 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:17.835601 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-273e25ab-27c8-4bea-975f-3bbc95de7594 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:17.857549 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:17.971494 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-273e25ab-27c8-4bea-975f-3bbc95de7594 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:17.979161 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-273e25ab-27c8-4bea-975f-3bbc95de7594 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:17.980674 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-273e25ab-27c8-4bea-975f-3bbc95de7594 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:17.982398 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-273e25ab-27c8-4bea-975f-3bbc95de7594 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.160797 Jun 29 11:27:17.982943 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 138/286] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:17 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:18.160375 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b9745f8-c37e-4fb0-9ca7-b3e0cc6942be tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:18.160985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b9745f8-c37e-4fb0-9ca7-b3e0cc6942be tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:18.164047 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:18.168064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9745f8-c37e-4fb0-9ca7-b3e0cc6942be tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:18.168512 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9745f8-c37e-4fb0-9ca7-b3e0cc6942be tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:18.169266 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9745f8-c37e-4fb0-9ca7-b3e0cc6942be tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:18.169692 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b9745f8-c37e-4fb0-9ca7-b3e0cc6942be tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:18.235479 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b9745f8-c37e-4fb0-9ca7-b3e0cc6942be tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:18.243297 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b9745f8-c37e-4fb0-9ca7-b3e0cc6942be tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1267 microversion: 2.1 time: 0.086680 Jun 29 11:27:18.243925 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 149/287] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:18 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:18.757078 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6b99cfba-f928-4fe9-9eb8-3ccbddf03eb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:18.757672 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6b99cfba-f928-4fe9-9eb8-3ccbddf03eb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:18.764048 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b99cfba-f928-4fe9-9eb8-3ccbddf03eb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:18.764482 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b99cfba-f928-4fe9-9eb8-3ccbddf03eb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:18.765223 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b99cfba-f928-4fe9-9eb8-3ccbddf03eb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:18.765648 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b99cfba-f928-4fe9-9eb8-3ccbddf03eb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:18.964360 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6b99cfba-f928-4fe9-9eb8-3ccbddf03eb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:18.972377 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6b99cfba-f928-4fe9-9eb8-3ccbddf03eb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1241 microversion: 2.1 time: 0.219448 Jun 29 11:27:18.972931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 139/288] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:18 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1241 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:19.000859 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c01dd394-412c-49eb-863f-12a09547d70c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:19.001460 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c01dd394-412c-49eb-863f-12a09547d70c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:19.007941 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c01dd394-412c-49eb-863f-12a09547d70c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:19.008385 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c01dd394-412c-49eb-863f-12a09547d70c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:19.010947 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c01dd394-412c-49eb-863f-12a09547d70c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:19.010947 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c01dd394-412c-49eb-863f-12a09547d70c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:19.136458 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c01dd394-412c-49eb-863f-12a09547d70c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:19.144960 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c01dd394-412c-49eb-863f-12a09547d70c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:19.146461 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c01dd394-412c-49eb-863f-12a09547d70c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:19.147606 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c01dd394-412c-49eb-863f-12a09547d70c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.151095 Jun 29 11:27:19.148415 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 150/289] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:18 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:19.261107 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-89441f2a-461e-4518-8115-9dbcb232a652 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:19.261916 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-89441f2a-461e-4518-8115-9dbcb232a652 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:19.268821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89441f2a-461e-4518-8115-9dbcb232a652 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:19.269266 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89441f2a-461e-4518-8115-9dbcb232a652 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:19.270020 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89441f2a-461e-4518-8115-9dbcb232a652 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:19.270454 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89441f2a-461e-4518-8115-9dbcb232a652 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:19.335978 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-89441f2a-461e-4518-8115-9dbcb232a652 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:19.343448 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-89441f2a-461e-4518-8115-9dbcb232a652 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1267 microversion: 2.1 time: 0.086299 Jun 29 11:27:19.344573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 140/290] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:19 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:19.989671 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2ee13b38-b44e-41e4-83f1-5441b8ad900e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:19.990284 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2ee13b38-b44e-41e4-83f1-5441b8ad900e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:19.996496 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ee13b38-b44e-41e4-83f1-5441b8ad900e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:19.996945 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ee13b38-b44e-41e4-83f1-5441b8ad900e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:19.997700 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ee13b38-b44e-41e4-83f1-5441b8ad900e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:19.998138 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ee13b38-b44e-41e4-83f1-5441b8ad900e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:20.063168 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ee13b38-b44e-41e4-83f1-5441b8ad900e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:20.070584 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2ee13b38-b44e-41e4-83f1-5441b8ad900e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1241 microversion: 2.1 time: 0.084814 Jun 29 11:27:20.071141 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 151/291] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:19 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:20.166335 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1a6479da-f264-46f0-8390-12edba6cdae0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:20.166966 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1a6479da-f264-46f0-8390-12edba6cdae0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:20.173862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a6479da-f264-46f0-8390-12edba6cdae0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:20.174301 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a6479da-f264-46f0-8390-12edba6cdae0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:20.175051 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a6479da-f264-46f0-8390-12edba6cdae0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:20.175479 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a6479da-f264-46f0-8390-12edba6cdae0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:20.309487 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1a6479da-f264-46f0-8390-12edba6cdae0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:20.323190 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1a6479da-f264-46f0-8390-12edba6cdae0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:20.324816 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1a6479da-f264-46f0-8390-12edba6cdae0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:20.325954 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1a6479da-f264-46f0-8390-12edba6cdae0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.163805 Jun 29 11:27:20.327030 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 141/292] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:20 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:20.368550 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e5013425-b915-4a62-8558-dbe74cef0a99 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:20.369320 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5013425-b915-4a62-8558-dbe74cef0a99 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:20.375402 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5013425-b915-4a62-8558-dbe74cef0a99 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:20.376024 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5013425-b915-4a62-8558-dbe74cef0a99 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:20.376932 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5013425-b915-4a62-8558-dbe74cef0a99 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:20.377296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5013425-b915-4a62-8558-dbe74cef0a99 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:20.440092 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e5013425-b915-4a62-8558-dbe74cef0a99 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:20.447452 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e5013425-b915-4a62-8558-dbe74cef0a99 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1267 microversion: 2.1 time: 0.082922 Jun 29 11:27:20.448043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 152/293] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:20 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:27:21.086505 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-09c98068-0b80-421c-b265-7a715f961ecf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:21.087108 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-09c98068-0b80-421c-b265-7a715f961ecf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:21.093179 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c98068-0b80-421c-b265-7a715f961ecf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:21.093619 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c98068-0b80-421c-b265-7a715f961ecf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:21.094399 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c98068-0b80-421c-b265-7a715f961ecf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:21.094816 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c98068-0b80-421c-b265-7a715f961ecf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:21.159852 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-09c98068-0b80-421c-b265-7a715f961ecf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:21.167312 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-09c98068-0b80-421c-b265-7a715f961ecf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1241 microversion: 2.1 time: 0.084609 Jun 29 11:27:21.167911 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 142/294] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:21 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:21.344241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e70477e8-75a5-45b6-9de1-903237b960bd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:21.344846 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e70477e8-75a5-45b6-9de1-903237b960bd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:21.351791 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e70477e8-75a5-45b6-9de1-903237b960bd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:21.352275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e70477e8-75a5-45b6-9de1-903237b960bd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:21.353026 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e70477e8-75a5-45b6-9de1-903237b960bd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:21.353450 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e70477e8-75a5-45b6-9de1-903237b960bd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:21.356050 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:21.464860 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e50ffc59-20f3-482f-8ab4-4e2bdb4ce80b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:21.465467 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e50ffc59-20f3-482f-8ab4-4e2bdb4ce80b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:21.472227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e50ffc59-20f3-482f-8ab4-4e2bdb4ce80b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:21.472670 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e50ffc59-20f3-482f-8ab4-4e2bdb4ce80b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:21.473428 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e50ffc59-20f3-482f-8ab4-4e2bdb4ce80b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:21.473855 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e50ffc59-20f3-482f-8ab4-4e2bdb4ce80b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:21.484540 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e70477e8-75a5-45b6-9de1-903237b960bd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:21.492385 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e70477e8-75a5-45b6-9de1-903237b960bd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:21.493869 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e70477e8-75a5-45b6-9de1-903237b960bd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:21.494957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e70477e8-75a5-45b6-9de1-903237b960bd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.154752 Jun 29 11:27:21.495506 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 153/295] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:21 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:21.535062 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e50ffc59-20f3-482f-8ab4-4e2bdb4ce80b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:21.543208 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e50ffc59-20f3-482f-8ab4-4e2bdb4ce80b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1267 microversion: 2.1 time: 0.082346 Jun 29 11:27:21.549365 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 143/296] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:21 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:27:22.183432 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f9aa937d-9e39-40cc-af3e-29316da604f7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:22.184070 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f9aa937d-9e39-40cc-af3e-29316da604f7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:22.190684 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9aa937d-9e39-40cc-af3e-29316da604f7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:22.191131 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9aa937d-9e39-40cc-af3e-29316da604f7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:22.191913 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9aa937d-9e39-40cc-af3e-29316da604f7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:22.192351 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9aa937d-9e39-40cc-af3e-29316da604f7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:22.256663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f9aa937d-9e39-40cc-af3e-29316da604f7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:22.263993 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f9aa937d-9e39-40cc-af3e-29316da604f7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1241 microversion: 2.1 time: 0.084382 Jun 29 11:27:22.264545 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 154/297] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:22 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:22.513108 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9b53605c-998e-43d6-9b73-704e4e6df430 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:22.513703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9b53605c-998e-43d6-9b73-704e4e6df430 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:22.519625 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b53605c-998e-43d6-9b73-704e4e6df430 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:22.520094 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b53605c-998e-43d6-9b73-704e4e6df430 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:22.520842 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b53605c-998e-43d6-9b73-704e4e6df430 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:22.521335 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b53605c-998e-43d6-9b73-704e4e6df430 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:22.561362 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1aa5a8ff-4cb3-49c9-8f0e-94f48187e00a tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:22.562566 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1aa5a8ff-4cb3-49c9-8f0e-94f48187e00a tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:22.568972 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1aa5a8ff-4cb3-49c9-8f0e-94f48187e00a tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:22.569418 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1aa5a8ff-4cb3-49c9-8f0e-94f48187e00a tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:22.570452 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1aa5a8ff-4cb3-49c9-8f0e-94f48187e00a tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:22.570845 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1aa5a8ff-4cb3-49c9-8f0e-94f48187e00a tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:22.638683 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1aa5a8ff-4cb3-49c9-8f0e-94f48187e00a tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:22.646671 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1aa5a8ff-4cb3-49c9-8f0e-94f48187e00a tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1267 microversion: 2.1 time: 0.090055 Jun 29 11:27:22.647222 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 155/298] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:22 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:27:22.675948 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9b53605c-998e-43d6-9b73-704e4e6df430 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:22.685174 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9b53605c-998e-43d6-9b73-704e4e6df430 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:22.686988 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9b53605c-998e-43d6-9b73-704e4e6df430 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:22.688119 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9b53605c-998e-43d6-9b73-704e4e6df430 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.178991 Jun 29 11:27:22.688911 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 144/299] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:22 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:23.279787 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8c2b3fad-50e8-45f3-8e86-f6aad1bd251e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:23.280415 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8c2b3fad-50e8-45f3-8e86-f6aad1bd251e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:23.286412 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c2b3fad-50e8-45f3-8e86-f6aad1bd251e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:23.286916 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c2b3fad-50e8-45f3-8e86-f6aad1bd251e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:23.287664 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c2b3fad-50e8-45f3-8e86-f6aad1bd251e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:23.288115 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c2b3fad-50e8-45f3-8e86-f6aad1bd251e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:23.355238 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8c2b3fad-50e8-45f3-8e86-f6aad1bd251e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:23.363092 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8c2b3fad-50e8-45f3-8e86-f6aad1bd251e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1241 microversion: 2.1 time: 0.087233 Jun 29 11:27:23.363648 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 156/300] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:23 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:23.662928 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4c0495ba-8f71-4288-9658-7bf4010433f3 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:23.663585 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4c0495ba-8f71-4288-9658-7bf4010433f3 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:23.669658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c0495ba-8f71-4288-9658-7bf4010433f3 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:23.670212 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c0495ba-8f71-4288-9658-7bf4010433f3 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:23.671045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c0495ba-8f71-4288-9658-7bf4010433f3 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:23.671537 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c0495ba-8f71-4288-9658-7bf4010433f3 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:23.706890 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3aff2246-f9a2-4441-8c50-03d6a7314e87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:23.707490 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3aff2246-f9a2-4441-8c50-03d6a7314e87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:23.715637 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3aff2246-f9a2-4441-8c50-03d6a7314e87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:23.716092 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3aff2246-f9a2-4441-8c50-03d6a7314e87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:23.716855 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3aff2246-f9a2-4441-8c50-03d6a7314e87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:23.717877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3aff2246-f9a2-4441-8c50-03d6a7314e87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:23.736861 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4c0495ba-8f71-4288-9658-7bf4010433f3 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:23.744114 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4c0495ba-8f71-4288-9658-7bf4010433f3 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1267 microversion: 2.1 time: 0.085117 Jun 29 11:27:23.744681 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 145/301] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:23 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:23.848089 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3aff2246-f9a2-4441-8c50-03d6a7314e87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:23.855961 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3aff2246-f9a2-4441-8c50-03d6a7314e87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:23.857465 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3aff2246-f9a2-4441-8c50-03d6a7314e87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:23.858559 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3aff2246-f9a2-4441-8c50-03d6a7314e87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.155504 Jun 29 11:27:23.859109 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 157/302] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:23 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:27:24.380226 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-01556de9-f972-4516-8204-877e52357626 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:24.380831 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-01556de9-f972-4516-8204-877e52357626 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:24.386909 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01556de9-f972-4516-8204-877e52357626 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:24.387411 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01556de9-f972-4516-8204-877e52357626 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:24.388196 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01556de9-f972-4516-8204-877e52357626 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:24.388629 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01556de9-f972-4516-8204-877e52357626 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:24.448566 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-01556de9-f972-4516-8204-877e52357626 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:24.457611 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-01556de9-f972-4516-8204-877e52357626 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1241 microversion: 2.1 time: 0.080986 Jun 29 11:27:24.458188 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 146/303] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:24 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:24.761436 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1ac9ab0-80d9-4ac0-be4b-029809fff68b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:24.762126 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c1ac9ab0-80d9-4ac0-be4b-029809fff68b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:24.769537 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1ac9ab0-80d9-4ac0-be4b-029809fff68b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:24.769985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1ac9ab0-80d9-4ac0-be4b-029809fff68b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:24.770746 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1ac9ab0-80d9-4ac0-be4b-029809fff68b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:24.771189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1ac9ab0-80d9-4ac0-be4b-029809fff68b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:24.834036 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1ac9ab0-80d9-4ac0-be4b-029809fff68b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:24.841336 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c1ac9ab0-80d9-4ac0-be4b-029809fff68b tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1267 microversion: 2.1 time: 0.083888 Jun 29 11:27:24.841899 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 158/304] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:24 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:24.877381 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3e65500a-c046-4538-a7e4-a76d18e4368d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:24.877987 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3e65500a-c046-4538-a7e4-a76d18e4368d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:24.884109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e65500a-c046-4538-a7e4-a76d18e4368d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:24.884598 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e65500a-c046-4538-a7e4-a76d18e4368d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:24.885354 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e65500a-c046-4538-a7e4-a76d18e4368d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:24.885789 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e65500a-c046-4538-a7e4-a76d18e4368d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:25.021323 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3e65500a-c046-4538-a7e4-a76d18e4368d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:25.040567 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3e65500a-c046-4538-a7e4-a76d18e4368d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:25.042097 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3e65500a-c046-4538-a7e4-a76d18e4368d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:25.043354 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3e65500a-c046-4538-a7e4-a76d18e4368d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.170325 Jun 29 11:27:25.054557 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 147/305] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:24 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:25.474556 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4415fb14-ea1f-405a-a124-f4d1e86d8547 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:25.475163 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4415fb14-ea1f-405a-a124-f4d1e86d8547 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:25.477042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:25.481794 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4415fb14-ea1f-405a-a124-f4d1e86d8547 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:25.482240 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4415fb14-ea1f-405a-a124-f4d1e86d8547 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:25.483600 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4415fb14-ea1f-405a-a124-f4d1e86d8547 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:25.484057 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4415fb14-ea1f-405a-a124-f4d1e86d8547 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:25.543083 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4415fb14-ea1f-405a-a124-f4d1e86d8547 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:25.551266 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4415fb14-ea1f-405a-a124-f4d1e86d8547 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1241 microversion: 2.1 time: 0.080500 Jun 29 11:27:25.551816 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 159/306] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:25 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:25.858626 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-48276482-4565-4232-ace8-6f2dc2a171da tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:25.859227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-48276482-4565-4232-ace8-6f2dc2a171da tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:25.865235 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-48276482-4565-4232-ace8-6f2dc2a171da tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:25.865587 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-48276482-4565-4232-ace8-6f2dc2a171da tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:25.866329 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-48276482-4565-4232-ace8-6f2dc2a171da tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:25.866755 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-48276482-4565-4232-ace8-6f2dc2a171da tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:25.925809 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-48276482-4565-4232-ace8-6f2dc2a171da tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:25.933277 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-48276482-4565-4232-ace8-6f2dc2a171da tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1267 microversion: 2.1 time: 0.078553 Jun 29 11:27:25.935178 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 148/307] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:25 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:26.062130 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bd93fc05-ff79-4c2c-88f7-bf084107f946 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:26.062737 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd93fc05-ff79-4c2c-88f7-bf084107f946 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:26.065060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=20 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:26.070060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd93fc05-ff79-4c2c-88f7-bf084107f946 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:26.070509 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd93fc05-ff79-4c2c-88f7-bf084107f946 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:26.072770 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd93fc05-ff79-4c2c-88f7-bf084107f946 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:26.072770 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd93fc05-ff79-4c2c-88f7-bf084107f946 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:26.203823 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd93fc05-ff79-4c2c-88f7-bf084107f946 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:26.212404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd93fc05-ff79-4c2c-88f7-bf084107f946 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:26.213925 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd93fc05-ff79-4c2c-88f7-bf084107f946 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:26.215077 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bd93fc05-ff79-4c2c-88f7-bf084107f946 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.157355 Jun 29 11:27:26.215796 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 160/308] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:26 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:27:26.567690 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3d7490ca-b700-4ab9-9eb5-775ef5132dd4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:26.568250 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3d7490ca-b700-4ab9-9eb5-775ef5132dd4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:26.571759 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:26.574644 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d7490ca-b700-4ab9-9eb5-775ef5132dd4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:26.575090 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d7490ca-b700-4ab9-9eb5-775ef5132dd4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:26.575873 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d7490ca-b700-4ab9-9eb5-775ef5132dd4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:26.576312 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d7490ca-b700-4ab9-9eb5-775ef5132dd4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:26.636498 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d7490ca-b700-4ab9-9eb5-775ef5132dd4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:26.644111 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3d7490ca-b700-4ab9-9eb5-775ef5132dd4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1241 microversion: 2.1 time: 0.080207 Jun 29 11:27:26.644670 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 149/309] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:26 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:26.950220 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf3d2508-b447-4b47-9bea-3469774058a6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:26.950832 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf3d2508-b447-4b47-9bea-3469774058a6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:26.956852 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf3d2508-b447-4b47-9bea-3469774058a6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:26.957302 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf3d2508-b447-4b47-9bea-3469774058a6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:26.958061 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf3d2508-b447-4b47-9bea-3469774058a6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:26.958496 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf3d2508-b447-4b47-9bea-3469774058a6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:27.017451 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cf3d2508-b447-4b47-9bea-3469774058a6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:27.024834 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf3d2508-b447-4b47-9bea-3469774058a6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1267 microversion: 2.1 time: 0.078492 Jun 29 11:27:27.025395 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 161/310] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:26 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:27.233285 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0fb7ecc5-ee68-434c-a534-32031877a0e4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:27.233887 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0fb7ecc5-ee68-434c-a534-32031877a0e4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:27.236064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=16 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:27.241211 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fb7ecc5-ee68-434c-a534-32031877a0e4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:27.241651 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fb7ecc5-ee68-434c-a534-32031877a0e4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:27.242401 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fb7ecc5-ee68-434c-a534-32031877a0e4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:27.242830 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fb7ecc5-ee68-434c-a534-32031877a0e4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:27.374403 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0fb7ecc5-ee68-434c-a534-32031877a0e4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:27.382252 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0fb7ecc5-ee68-434c-a534-32031877a0e4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:27.383762 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0fb7ecc5-ee68-434c-a534-32031877a0e4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:27.384907 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0fb7ecc5-ee68-434c-a534-32031877a0e4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.155512 Jun 29 11:27:27.385453 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 150/311] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:27 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:27.660378 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e9dc868-f4cc-4e72-b3af-9666103abaea tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:27.661003 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7e9dc868-f4cc-4e72-b3af-9666103abaea tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:27.667314 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e9dc868-f4cc-4e72-b3af-9666103abaea tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:27.667753 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e9dc868-f4cc-4e72-b3af-9666103abaea tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:27.668556 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e9dc868-f4cc-4e72-b3af-9666103abaea tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:27.668982 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e9dc868-f4cc-4e72-b3af-9666103abaea tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:27.730207 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7e9dc868-f4cc-4e72-b3af-9666103abaea tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:27.737847 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7e9dc868-f4cc-4e72-b3af-9666103abaea tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1241 microversion: 2.1 time: 0.081206 Jun 29 11:27:27.738408 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 162/312] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:27 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:28.042155 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5436c8ac-67b1-4308-8a58-0d893986d1ca tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:28.042757 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5436c8ac-67b1-4308-8a58-0d893986d1ca tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:28.049301 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5436c8ac-67b1-4308-8a58-0d893986d1ca tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:28.049751 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5436c8ac-67b1-4308-8a58-0d893986d1ca tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:28.050497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5436c8ac-67b1-4308-8a58-0d893986d1ca tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:28.050927 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5436c8ac-67b1-4308-8a58-0d893986d1ca tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:28.112068 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5436c8ac-67b1-4308-8a58-0d893986d1ca tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:28.119479 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5436c8ac-67b1-4308-8a58-0d893986d1ca tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1275 microversion: 2.1 time: 0.081147 Jun 29 11:27:28.120080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 151/313] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:28 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1275 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:28.403393 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6c7a444d-49a0-4942-a691-8ca46bb15eb7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:28.404029 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6c7a444d-49a0-4942-a691-8ca46bb15eb7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:28.410613 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c7a444d-49a0-4942-a691-8ca46bb15eb7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:28.411056 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c7a444d-49a0-4942-a691-8ca46bb15eb7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:28.411819 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c7a444d-49a0-4942-a691-8ca46bb15eb7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:28.412274 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c7a444d-49a0-4942-a691-8ca46bb15eb7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:28.539364 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6c7a444d-49a0-4942-a691-8ca46bb15eb7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:28.547792 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6c7a444d-49a0-4942-a691-8ca46bb15eb7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:28.549302 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6c7a444d-49a0-4942-a691-8ca46bb15eb7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:28.550385 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6c7a444d-49a0-4942-a691-8ca46bb15eb7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.150977 Jun 29 11:27:28.550926 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 163/314] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:28 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:28.754214 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9b20f44b-e5c5-453a-bd3a-e5e410915e0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:28.754848 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9b20f44b-e5c5-453a-bd3a-e5e410915e0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:28.760782 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b20f44b-e5c5-453a-bd3a-e5e410915e0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:28.761223 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b20f44b-e5c5-453a-bd3a-e5e410915e0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:28.761971 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b20f44b-e5c5-453a-bd3a-e5e410915e0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:28.762401 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b20f44b-e5c5-453a-bd3a-e5e410915e0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:28.821889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9b20f44b-e5c5-453a-bd3a-e5e410915e0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:28.829707 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9b20f44b-e5c5-453a-bd3a-e5e410915e0c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1297 microversion: 2.1 time: 0.079278 Jun 29 11:27:28.830262 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 152/315] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:28 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1297 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:29.138390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4936d988-d6aa-4f04-8890-4f00b95fe99f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:29.138957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4936d988-d6aa-4f04-8890-4f00b95fe99f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:29.145297 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4936d988-d6aa-4f04-8890-4f00b95fe99f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:29.145741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4936d988-d6aa-4f04-8890-4f00b95fe99f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:29.148458 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4936d988-d6aa-4f04-8890-4f00b95fe99f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:29.148458 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4936d988-d6aa-4f04-8890-4f00b95fe99f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:29.227632 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4936d988-d6aa-4f04-8890-4f00b95fe99f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:29.236060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4936d988-d6aa-4f04-8890-4f00b95fe99f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1275 microversion: 2.1 time: 0.101467 Jun 29 11:27:29.236612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 164/316] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:29 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:29.568026 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4d12bf5f-eb53-45fc-8f86-26f6f26b8472 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:29.568608 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4d12bf5f-eb53-45fc-8f86-26f6f26b8472 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:29.574750 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d12bf5f-eb53-45fc-8f86-26f6f26b8472 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:29.575190 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d12bf5f-eb53-45fc-8f86-26f6f26b8472 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:29.576056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d12bf5f-eb53-45fc-8f86-26f6f26b8472 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:29.576981 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d12bf5f-eb53-45fc-8f86-26f6f26b8472 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:29.701343 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4d12bf5f-eb53-45fc-8f86-26f6f26b8472 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:29.710053 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4d12bf5f-eb53-45fc-8f86-26f6f26b8472 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:29.711548 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4d12bf5f-eb53-45fc-8f86-26f6f26b8472 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:29.712667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4d12bf5f-eb53-45fc-8f86-26f6f26b8472 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.148598 Jun 29 11:27:29.713215 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 153/317] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:29 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:29.845615 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d1812e7-fb87-4b74-8da2-8035df6bf1e6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:29.846180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0d1812e7-fb87-4b74-8da2-8035df6bf1e6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:29.852147 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d1812e7-fb87-4b74-8da2-8035df6bf1e6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:29.852621 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d1812e7-fb87-4b74-8da2-8035df6bf1e6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:29.853366 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d1812e7-fb87-4b74-8da2-8035df6bf1e6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:29.853796 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d1812e7-fb87-4b74-8da2-8035df6bf1e6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:29.916129 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0d1812e7-fb87-4b74-8da2-8035df6bf1e6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:29.923635 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0d1812e7-fb87-4b74-8da2-8035df6bf1e6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1297 microversion: 2.1 time: 0.082195 Jun 29 11:27:29.924221 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 165/318] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:29 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:30.253276 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fceb5428-205e-479a-a1d1-13cf3603220e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:30.253883 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fceb5428-205e-479a-a1d1-13cf3603220e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:30.259851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fceb5428-205e-479a-a1d1-13cf3603220e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:30.260307 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fceb5428-205e-479a-a1d1-13cf3603220e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:30.261063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fceb5428-205e-479a-a1d1-13cf3603220e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:30.261488 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fceb5428-205e-479a-a1d1-13cf3603220e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:30.328125 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fceb5428-205e-479a-a1d1-13cf3603220e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:30.343742 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fceb5428-205e-479a-a1d1-13cf3603220e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1285 microversion: 2.1 time: 0.094210 Jun 29 11:27:30.353939 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 154/319] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:30 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:30.733336 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4be2e721-cd37-440a-bbb3-110129818fa0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:30.734722 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4be2e721-cd37-440a-bbb3-110129818fa0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:30.741404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4be2e721-cd37-440a-bbb3-110129818fa0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:30.741933 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4be2e721-cd37-440a-bbb3-110129818fa0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:30.742901 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4be2e721-cd37-440a-bbb3-110129818fa0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:30.743372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4be2e721-cd37-440a-bbb3-110129818fa0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:30.940301 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4be2e721-cd37-440a-bbb3-110129818fa0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:30.941737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7addeea7-c341-4e77-9d4f-e1983e504545 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:30.942891 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7addeea7-c341-4e77-9d4f-e1983e504545 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:30.950177 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7addeea7-c341-4e77-9d4f-e1983e504545 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:30.950571 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4be2e721-cd37-440a-bbb3-110129818fa0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:30.950715 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7addeea7-c341-4e77-9d4f-e1983e504545 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:30.952632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7addeea7-c341-4e77-9d4f-e1983e504545 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:30.952780 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4be2e721-cd37-440a-bbb3-110129818fa0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:30.953413 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7addeea7-c341-4e77-9d4f-e1983e504545 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:30.953782 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4be2e721-cd37-440a-bbb3-110129818fa0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.226621 Jun 29 11:27:30.954404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 166/320] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:30 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:30.958117 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:31.020671 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7addeea7-c341-4e77-9d4f-e1983e504545 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:31.027953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7addeea7-c341-4e77-9d4f-e1983e504545 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1303 microversion: 2.1 time: 0.091313 Jun 29 11:27:31.028884 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 155/321] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:30 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:31.364513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c60d1f17-df44-49ae-a8fc-a0841bdaf659 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:31.365060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c60d1f17-df44-49ae-a8fc-a0841bdaf659 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:31.371855 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c60d1f17-df44-49ae-a8fc-a0841bdaf659 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:31.372337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c60d1f17-df44-49ae-a8fc-a0841bdaf659 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:31.373358 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c60d1f17-df44-49ae-a8fc-a0841bdaf659 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:31.373881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c60d1f17-df44-49ae-a8fc-a0841bdaf659 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:31.637358 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c60d1f17-df44-49ae-a8fc-a0841bdaf659 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:31.676329 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c60d1f17-df44-49ae-a8fc-a0841bdaf659 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.319067 Jun 29 11:27:31.680115 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 167/322] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:31 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:31.972605 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-775a76f7-d973-45bb-82f2-01042e15223a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:31.973237 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-775a76f7-d973-45bb-82f2-01042e15223a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:31.979739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-775a76f7-d973-45bb-82f2-01042e15223a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:31.980215 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-775a76f7-d973-45bb-82f2-01042e15223a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:31.980979 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-775a76f7-d973-45bb-82f2-01042e15223a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:31.981424 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-775a76f7-d973-45bb-82f2-01042e15223a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:32.048166 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-895bbfab-a5a6-41e2-98dd-4182a3a5a55b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:32.050533 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-895bbfab-a5a6-41e2-98dd-4182a3a5a55b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:32.063403 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-895bbfab-a5a6-41e2-98dd-4182a3a5a55b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:32.070546 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-895bbfab-a5a6-41e2-98dd-4182a3a5a55b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:32.072863 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-895bbfab-a5a6-41e2-98dd-4182a3a5a55b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:32.073494 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-895bbfab-a5a6-41e2-98dd-4182a3a5a55b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:32.485299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-775a76f7-d973-45bb-82f2-01042e15223a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:32.511966 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-775a76f7-d973-45bb-82f2-01042e15223a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:32.513679 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-775a76f7-d973-45bb-82f2-01042e15223a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:32.515377 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-775a76f7-d973-45bb-82f2-01042e15223a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.547029 Jun 29 11:27:32.533182 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 156/323] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:31 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:32.538512 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-7633fb05-cf27-4f5e-9b9a-d8fca50a5596 req-db9df1d8-fcb0-4271-9da2-f01e16169cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde34fdf-bfe6-48a4-9b9e-95ff879ffa70", "name": "network-vif-plugged", "status": "completed", "tag": "dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:32.548884 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7633fb05-cf27-4f5e-9b9a-d8fca50a5596 req-db9df1d8-fcb0-4271-9da2-f01e16169cf7 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:32.550086 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7633fb05-cf27-4f5e-9b9a-d8fca50a5596 req-db9df1d8-fcb0-4271-9da2-f01e16169cf7 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:32.565192 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-7633fb05-cf27-4f5e-9b9a-d8fca50a5596 req-db9df1d8-fcb0-4271-9da2-f01e16169cf7 service nova] Creating event network-vif-plugged:dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48 for instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 on hv-cinder-84733 Jun 29 11:27:32.570903 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-7633fb05-cf27-4f5e-9b9a-d8fca50a5596 req-db9df1d8-fcb0-4271-9da2-f01e16169cf7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036475 Jun 29 11:27:32.571749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 157/324] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:27:32.624760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-895bbfab-a5a6-41e2-98dd-4182a3a5a55b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:32.637933 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-895bbfab-a5a6-41e2-98dd-4182a3a5a55b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.594685 Jun 29 11:27:32.639762 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 168/325] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:32 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:32.708335 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-83e29999-57c4-419c-8e37-73b5b173c0d5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:32.709483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-83e29999-57c4-419c-8e37-73b5b173c0d5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:32.718231 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83e29999-57c4-419c-8e37-73b5b173c0d5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:32.718700 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83e29999-57c4-419c-8e37-73b5b173c0d5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:32.719475 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83e29999-57c4-419c-8e37-73b5b173c0d5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:32.720307 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83e29999-57c4-419c-8e37-73b5b173c0d5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:32.765505 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-e55f67ec-449c-46df-ba5b-8a8938896ed4 req-07c957c7-00a3-4369-8ce1-15a96cec0b32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3fb170-5d34-4fa4-8baa-5e404f52f4f2", "tag": "5593c143-d87b-466f-b8ca-17159064e710"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:32.779879 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e55f67ec-449c-46df-ba5b-8a8938896ed4 req-07c957c7-00a3-4369-8ce1-15a96cec0b32 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:32.780111 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e55f67ec-449c-46df-ba5b-8a8938896ed4 req-07c957c7-00a3-4369-8ce1-15a96cec0b32 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:32.800536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-e55f67ec-449c-46df-ba5b-8a8938896ed4 req-07c957c7-00a3-4369-8ce1-15a96cec0b32 service nova] Creating event network-changed:5593c143-d87b-466f-b8ca-17159064e710 for instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 on hv-cinder-84733 Jun 29 11:27:32.809912 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-e55f67ec-449c-46df-ba5b-8a8938896ed4 req-07c957c7-00a3-4369-8ce1-15a96cec0b32 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049779 Jun 29 11:27:32.818440 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 169/326] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:27:32.853426 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-8a7a3b75-bc6a-424f-a5e2-97db65fb6f26 req-ecf7e3a4-7919-4ade-95ee-818d4f8acd24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e950cf0f-7240-42de-a478-d5f963396be3", "tag": "3250b63e-97dc-4536-93b3-6a31ea96e36f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:32.862400 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8a7a3b75-bc6a-424f-a5e2-97db65fb6f26 req-ecf7e3a4-7919-4ade-95ee-818d4f8acd24 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:32.863195 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8a7a3b75-bc6a-424f-a5e2-97db65fb6f26 req-ecf7e3a4-7919-4ade-95ee-818d4f8acd24 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:32.884062 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-8a7a3b75-bc6a-424f-a5e2-97db65fb6f26 req-ecf7e3a4-7919-4ade-95ee-818d4f8acd24 service nova] Creating event network-changed:3250b63e-97dc-4536-93b3-6a31ea96e36f for instance e950cf0f-7240-42de-a478-d5f963396be3 on hv-cinder-84733 Jun 29 11:27:32.889813 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-8a7a3b75-bc6a-424f-a5e2-97db65fb6f26 req-ecf7e3a4-7919-4ade-95ee-818d4f8acd24 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039942 Jun 29 11:27:32.890418 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 170/327] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:27:32.943686 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-83e29999-57c4-419c-8e37-73b5b173c0d5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:32.952699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-83e29999-57c4-419c-8e37-73b5b173c0d5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.249497 Jun 29 11:27:32.953452 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 158/328] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:32 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:33.560566 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bcd60c36-e15c-478d-a181-b9a9be32000c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:33.561257 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bcd60c36-e15c-478d-a181-b9a9be32000c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:33.567461 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcd60c36-e15c-478d-a181-b9a9be32000c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:33.567947 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcd60c36-e15c-478d-a181-b9a9be32000c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:33.568704 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcd60c36-e15c-478d-a181-b9a9be32000c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:33.569135 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcd60c36-e15c-478d-a181-b9a9be32000c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:33.571694 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:33.656119 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5b83e728-c152-4917-9416-3deda1d87c97 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:33.656718 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5b83e728-c152-4917-9416-3deda1d87c97 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:33.662713 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b83e728-c152-4917-9416-3deda1d87c97 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:33.663151 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b83e728-c152-4917-9416-3deda1d87c97 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:33.663959 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b83e728-c152-4917-9416-3deda1d87c97 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:33.664425 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b83e728-c152-4917-9416-3deda1d87c97 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:33.710242 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcd60c36-e15c-478d-a181-b9a9be32000c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:33.718661 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcd60c36-e15c-478d-a181-b9a9be32000c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:33.720551 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcd60c36-e15c-478d-a181-b9a9be32000c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:33.721719 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bcd60c36-e15c-478d-a181-b9a9be32000c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.165872 Jun 29 11:27:33.722350 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 171/329] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:33 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:33.791099 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5b83e728-c152-4917-9416-3deda1d87c97 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:33.799131 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5b83e728-c152-4917-9416-3deda1d87c97 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.147427 Jun 29 11:27:33.799693 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 159/330] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:33 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:27:33.970466 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fef29fa4-e191-4d43-8a81-2d18132e15c2 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:33.971067 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fef29fa4-e191-4d43-8a81-2d18132e15c2 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:33.977003 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fef29fa4-e191-4d43-8a81-2d18132e15c2 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:33.977448 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fef29fa4-e191-4d43-8a81-2d18132e15c2 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:33.978201 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fef29fa4-e191-4d43-8a81-2d18132e15c2 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:33.978631 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fef29fa4-e191-4d43-8a81-2d18132e15c2 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:34.106892 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fef29fa4-e191-4d43-8a81-2d18132e15c2 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:34.114325 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fef29fa4-e191-4d43-8a81-2d18132e15c2 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.148616 Jun 29 11:27:34.114876 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 172/331] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:33 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:34.739349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-20ad3206-e234-4a66-832e-94ddce2511ec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:34.739974 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-20ad3206-e234-4a66-832e-94ddce2511ec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:34.745907 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20ad3206-e234-4a66-832e-94ddce2511ec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:34.746346 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20ad3206-e234-4a66-832e-94ddce2511ec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:34.747117 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20ad3206-e234-4a66-832e-94ddce2511ec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:34.747543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20ad3206-e234-4a66-832e-94ddce2511ec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:34.816818 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6d206795-ad94-416c-8c4a-6644a5b92ce5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:34.817510 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6d206795-ad94-416c-8c4a-6644a5b92ce5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:34.824367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d206795-ad94-416c-8c4a-6644a5b92ce5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:34.824883 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d206795-ad94-416c-8c4a-6644a5b92ce5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:34.825856 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d206795-ad94-416c-8c4a-6644a5b92ce5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:34.826358 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d206795-ad94-416c-8c4a-6644a5b92ce5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:35.105715 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-20ad3206-e234-4a66-832e-94ddce2511ec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:35.105715 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-20ad3206-e234-4a66-832e-94ddce2511ec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:35.105924 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-20ad3206-e234-4a66-832e-94ddce2511ec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:35.105924 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-20ad3206-e234-4a66-832e-94ddce2511ec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.182487 Jun 29 11:27:35.105924 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 160/332] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:34 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:35.106181 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6d206795-ad94-416c-8c4a-6644a5b92ce5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:35.106181 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6d206795-ad94-416c-8c4a-6644a5b92ce5 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.169037 Jun 29 11:27:35.106181 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 173/333] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:34 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:27:35.131123 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-640552ab-b3f3-456a-9303-3451d5001c97 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:35.131732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-640552ab-b3f3-456a-9303-3451d5001c97 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:35.137867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-640552ab-b3f3-456a-9303-3451d5001c97 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:35.138320 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-640552ab-b3f3-456a-9303-3451d5001c97 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:35.139082 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-640552ab-b3f3-456a-9303-3451d5001c97 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:35.139524 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-640552ab-b3f3-456a-9303-3451d5001c97 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:35.492620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-640552ab-b3f3-456a-9303-3451d5001c97 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:35.492620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-640552ab-b3f3-456a-9303-3451d5001c97 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.146008 Jun 29 11:27:35.492620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 161/334] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:35 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:36.124002 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8decf264-917c-4d70-95b5-1ec5926fcf28 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:36.124528 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8decf264-917c-4d70-95b5-1ec5926fcf28 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:36.124915 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3031f414-f5ed-48bd-8d93-1421ba7746ab tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:36.125534 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3031f414-f5ed-48bd-8d93-1421ba7746ab tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:36.127497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:36.131159 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8decf264-917c-4d70-95b5-1ec5926fcf28 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:36.131609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8decf264-917c-4d70-95b5-1ec5926fcf28 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:36.132107 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3031f414-f5ed-48bd-8d93-1421ba7746ab tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:36.132401 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8decf264-917c-4d70-95b5-1ec5926fcf28 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:36.132629 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3031f414-f5ed-48bd-8d93-1421ba7746ab tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:36.132831 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8decf264-917c-4d70-95b5-1ec5926fcf28 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:36.133483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3031f414-f5ed-48bd-8d93-1421ba7746ab tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:36.133918 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3031f414-f5ed-48bd-8d93-1421ba7746ab tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:36.324234 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8decf264-917c-4d70-95b5-1ec5926fcf28 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:36.331395 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3031f414-f5ed-48bd-8d93-1421ba7746ab tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:36.332362 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8decf264-917c-4d70-95b5-1ec5926fcf28 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.212234 Jun 29 11:27:36.332941 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 174/335] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:36 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:36.339220 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3031f414-f5ed-48bd-8d93-1421ba7746ab tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:36.340748 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3031f414-f5ed-48bd-8d93-1421ba7746ab tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:36.341836 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3031f414-f5ed-48bd-8d93-1421ba7746ab tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.220752 Jun 29 11:27:36.342995 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 162/336] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:36 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:27:36.496502 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c81733bc-5dfd-49bb-a28d-d28b8221a4e0 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:36.497118 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c81733bc-5dfd-49bb-a28d-d28b8221a4e0 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:36.503601 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c81733bc-5dfd-49bb-a28d-d28b8221a4e0 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:36.504225 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c81733bc-5dfd-49bb-a28d-d28b8221a4e0 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:36.505009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c81733bc-5dfd-49bb-a28d-d28b8221a4e0 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:36.505458 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c81733bc-5dfd-49bb-a28d-d28b8221a4e0 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:36.704336 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c81733bc-5dfd-49bb-a28d-d28b8221a4e0 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:36.712161 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c81733bc-5dfd-49bb-a28d-d28b8221a4e0 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.219821 Jun 29 11:27:36.712932 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 175/337] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:36 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:37.349382 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-80d510bb-8aaf-4ee8-8353-28b3b71b0e64 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:37.349984 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-80d510bb-8aaf-4ee8-8353-28b3b71b0e64 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:37.356191 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80d510bb-8aaf-4ee8-8353-28b3b71b0e64 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:37.356631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80d510bb-8aaf-4ee8-8353-28b3b71b0e64 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:37.357377 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80d510bb-8aaf-4ee8-8353-28b3b71b0e64 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:37.359328 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80d510bb-8aaf-4ee8-8353-28b3b71b0e64 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:37.360417 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ba18758a-828c-45e7-8704-ec3c5335de23 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:37.361038 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ba18758a-828c-45e7-8704-ec3c5335de23 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:37.368278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba18758a-828c-45e7-8704-ec3c5335de23 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:37.368728 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba18758a-828c-45e7-8704-ec3c5335de23 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:37.369493 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba18758a-828c-45e7-8704-ec3c5335de23 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:37.369927 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba18758a-828c-45e7-8704-ec3c5335de23 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:37.549604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-80d510bb-8aaf-4ee8-8353-28b3b71b0e64 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:37.557377 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-80d510bb-8aaf-4ee8-8353-28b3b71b0e64 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.212216 Jun 29 11:27:37.558032 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 163/338] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:37 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:37.562545 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ba18758a-828c-45e7-8704-ec3c5335de23 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:37.570694 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ba18758a-828c-45e7-8704-ec3c5335de23 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:37.572302 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ba18758a-828c-45e7-8704-ec3c5335de23 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:37.573490 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ba18758a-828c-45e7-8704-ec3c5335de23 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.217046 Jun 29 11:27:37.574040 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 176/339] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:37 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:27:37.729291 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4b94c78e-a0a6-4480-b4d6-e8640e467716 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:37.729916 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4b94c78e-a0a6-4480-b4d6-e8640e467716 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:37.736640 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b94c78e-a0a6-4480-b4d6-e8640e467716 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:37.737086 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b94c78e-a0a6-4480-b4d6-e8640e467716 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:37.737842 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b94c78e-a0a6-4480-b4d6-e8640e467716 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:37.738277 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b94c78e-a0a6-4480-b4d6-e8640e467716 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:37.869064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4b94c78e-a0a6-4480-b4d6-e8640e467716 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:37.877200 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4b94c78e-a0a6-4480-b4d6-e8640e467716 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.151847 Jun 29 11:27:37.877766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 164/340] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:37 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:38.574323 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5eca92db-97d0-4437-b003-b0510b76d5f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:38.575573 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5eca92db-97d0-4437-b003-b0510b76d5f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:38.601168 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5eca92db-97d0-4437-b003-b0510b76d5f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:38.601168 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5eca92db-97d0-4437-b003-b0510b76d5f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:38.601168 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5eca92db-97d0-4437-b003-b0510b76d5f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:38.601168 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5eca92db-97d0-4437-b003-b0510b76d5f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:38.601764 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6085a2b4-a19a-4913-90af-c0e76820d13f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:38.601764 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6085a2b4-a19a-4913-90af-c0e76820d13f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:38.603577 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6085a2b4-a19a-4913-90af-c0e76820d13f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:38.604366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6085a2b4-a19a-4913-90af-c0e76820d13f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:38.605117 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6085a2b4-a19a-4913-90af-c0e76820d13f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:38.605665 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6085a2b4-a19a-4913-90af-c0e76820d13f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:38.815119 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5eca92db-97d0-4437-b003-b0510b76d5f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:38.819313 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6085a2b4-a19a-4913-90af-c0e76820d13f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:38.823102 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5eca92db-97d0-4437-b003-b0510b76d5f2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.252617 Jun 29 11:27:38.823899 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 177/341] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:38 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:38.829529 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6085a2b4-a19a-4913-90af-c0e76820d13f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:38.831104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6085a2b4-a19a-4913-90af-c0e76820d13f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:38.832650 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6085a2b4-a19a-4913-90af-c0e76820d13f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1407 microversion: 2.20 time: 0.243427 Jun 29 11:27:38.851859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 165/342] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:38 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:27:38.894398 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b82d731-a450-441d-8f69-6be4ac22e58c tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:38.895013 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b82d731-a450-441d-8f69-6be4ac22e58c tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:38.910806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b82d731-a450-441d-8f69-6be4ac22e58c tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:38.911304 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b82d731-a450-441d-8f69-6be4ac22e58c tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:38.912146 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b82d731-a450-441d-8f69-6be4ac22e58c tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:38.915176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b82d731-a450-441d-8f69-6be4ac22e58c tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:39.165575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b82d731-a450-441d-8f69-6be4ac22e58c tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:39.173590 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b82d731-a450-441d-8f69-6be4ac22e58c tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.283250 Jun 29 11:27:39.174420 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 178/343] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:38 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:39.840060 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3e37a82b-acae-4526-acbf-1f149dced0fe tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:39.840927 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3e37a82b-acae-4526-acbf-1f149dced0fe tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:39.847331 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e37a82b-acae-4526-acbf-1f149dced0fe tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:39.847891 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e37a82b-acae-4526-acbf-1f149dced0fe tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:39.848649 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e37a82b-acae-4526-acbf-1f149dced0fe tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:39.849083 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e37a82b-acae-4526-acbf-1f149dced0fe tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:39.859801 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b8b1127-9f97-4ab0-8505-ffb0eb3a1378 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:39.860688 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b8b1127-9f97-4ab0-8505-ffb0eb3a1378 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:39.868995 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b8b1127-9f97-4ab0-8505-ffb0eb3a1378 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:39.869703 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b8b1127-9f97-4ab0-8505-ffb0eb3a1378 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:39.870757 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b8b1127-9f97-4ab0-8505-ffb0eb3a1378 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:39.871488 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b8b1127-9f97-4ab0-8505-ffb0eb3a1378 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:40.058467 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3e37a82b-acae-4526-acbf-1f149dced0fe tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:40.071269 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3e37a82b-acae-4526-acbf-1f149dced0fe tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.235036 Jun 29 11:27:40.085620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 166/344] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:39 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:40.085792 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b8b1127-9f97-4ab0-8505-ffb0eb3a1378 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:40.092959 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b8b1127-9f97-4ab0-8505-ffb0eb3a1378 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:40.094983 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b8b1127-9f97-4ab0-8505-ffb0eb3a1378 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:40.096685 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b8b1127-9f97-4ab0-8505-ffb0eb3a1378 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1599 microversion: 2.20 time: 0.241396 Jun 29 11:27:40.097396 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 179/345] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:27:39 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1599 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:27:40.115440 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f330f0e5-a10a-4633-b66d-5adc74e9cf05 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:40.116635 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f330f0e5-a10a-4633-b66d-5adc74e9cf05 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:40.123703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f330f0e5-a10a-4633-b66d-5adc74e9cf05 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:40.124294 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f330f0e5-a10a-4633-b66d-5adc74e9cf05 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:40.125208 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f330f0e5-a10a-4633-b66d-5adc74e9cf05 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:40.125852 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f330f0e5-a10a-4633-b66d-5adc74e9cf05 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:40.192810 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c6aaddb7-a542-4e4e-a97d-833dae626fa5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:40.193554 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c6aaddb7-a542-4e4e-a97d-833dae626fa5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:40.200321 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6aaddb7-a542-4e4e-a97d-833dae626fa5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:40.202114 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6aaddb7-a542-4e4e-a97d-833dae626fa5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:40.202517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6aaddb7-a542-4e4e-a97d-833dae626fa5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:40.203058 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6aaddb7-a542-4e4e-a97d-833dae626fa5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:40.211134 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f330f0e5-a10a-4633-b66d-5adc74e9cf05 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100434 Jun 29 11:27:40.211995 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 167/346] 10.222.0.44 () {60 vars in 1315 bytes} [Wed Jun 29 11:27:40 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:27:40.484687 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c6aaddb7-a542-4e4e-a97d-833dae626fa5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:40.498959 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c6aaddb7-a542-4e4e-a97d-833dae626fa5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.310067 Jun 29 11:27:40.504464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 180/347] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:40 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:41.088839 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2c929976-bda3-4c5a-9345-314d24b16aa9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:41.089479 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2c929976-bda3-4c5a-9345-314d24b16aa9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:41.096649 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2c929976-bda3-4c5a-9345-314d24b16aa9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:41.097093 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2c929976-bda3-4c5a-9345-314d24b16aa9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:41.097939 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2c929976-bda3-4c5a-9345-314d24b16aa9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:41.098686 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2c929976-bda3-4c5a-9345-314d24b16aa9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:41.313535 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2c929976-bda3-4c5a-9345-314d24b16aa9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:41.322132 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2c929976-bda3-4c5a-9345-314d24b16aa9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.237118 Jun 29 11:27:41.334077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 168/348] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:41 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:41.515079 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7990fceb-f314-43f3-a981-997d7f7d1317 req-778ac0ee-8a7f-409b-bd83-2d7f4213eec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde34fdf-bfe6-48a4-9b9e-95ff879ffa70", "tag": "dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:41.521737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-32b7259f-5856-4cb9-b540-21c8a7a3c26e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:41.523697 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-32b7259f-5856-4cb9-b540-21c8a7a3c26e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:41.526416 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7990fceb-f314-43f3-a981-997d7f7d1317 req-778ac0ee-8a7f-409b-bd83-2d7f4213eec1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:41.527374 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7990fceb-f314-43f3-a981-997d7f7d1317 req-778ac0ee-8a7f-409b-bd83-2d7f4213eec1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:41.532627 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32b7259f-5856-4cb9-b540-21c8a7a3c26e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:41.533287 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32b7259f-5856-4cb9-b540-21c8a7a3c26e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:41.534803 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32b7259f-5856-4cb9-b540-21c8a7a3c26e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:41.541888 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7990fceb-f314-43f3-a981-997d7f7d1317 req-778ac0ee-8a7f-409b-bd83-2d7f4213eec1 service nova] Creating event network-changed:dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48 for instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 on hv-cinder-84733 Jun 29 11:27:41.543183 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32b7259f-5856-4cb9-b540-21c8a7a3c26e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:41.548513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7990fceb-f314-43f3-a981-997d7f7d1317 req-778ac0ee-8a7f-409b-bd83-2d7f4213eec1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039674 Jun 29 11:27:41.549774 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 181/349] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:27:41.724101 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-32b7259f-5856-4cb9-b540-21c8a7a3c26e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:41.736954 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-32b7259f-5856-4cb9-b540-21c8a7a3c26e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.222808 Jun 29 11:27:41.738393 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 169/350] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:41 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:42.338945 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9d1a1cf2-7c1c-4a5a-9586-0c1332090b18 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:42.339994 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9d1a1cf2-7c1c-4a5a-9586-0c1332090b18 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:42.346247 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d1a1cf2-7c1c-4a5a-9586-0c1332090b18 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:42.346550 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d1a1cf2-7c1c-4a5a-9586-0c1332090b18 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:42.347404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d1a1cf2-7c1c-4a5a-9586-0c1332090b18 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:42.347996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d1a1cf2-7c1c-4a5a-9586-0c1332090b18 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:42.502295 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9d1a1cf2-7c1c-4a5a-9586-0c1332090b18 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:42.510537 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9d1a1cf2-7c1c-4a5a-9586-0c1332090b18 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.175652 Jun 29 11:27:42.511121 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 182/351] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:42 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:42.757723 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0cbbed23-ff14-4051-95c2-78e65e812eb5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:42.758173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0cbbed23-ff14-4051-95c2-78e65e812eb5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:42.775405 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cbbed23-ff14-4051-95c2-78e65e812eb5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:42.775873 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cbbed23-ff14-4051-95c2-78e65e812eb5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:42.776647 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cbbed23-ff14-4051-95c2-78e65e812eb5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:42.784436 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cbbed23-ff14-4051-95c2-78e65e812eb5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:42.984437 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0cbbed23-ff14-4051-95c2-78e65e812eb5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:42.994626 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0cbbed23-ff14-4051-95c2-78e65e812eb5 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.241514 Jun 29 11:27:43.005960 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 170/352] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:42 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:43.526948 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a4356092-876d-4e93-bc4a-3e873154522f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:43.527577 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a4356092-876d-4e93-bc4a-3e873154522f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:43.534217 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4356092-876d-4e93-bc4a-3e873154522f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:43.534672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4356092-876d-4e93-bc4a-3e873154522f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:43.535444 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4356092-876d-4e93-bc4a-3e873154522f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:43.537713 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4356092-876d-4e93-bc4a-3e873154522f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:43.739928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a4356092-876d-4e93-bc4a-3e873154522f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:43.750459 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a4356092-876d-4e93-bc4a-3e873154522f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.227186 Jun 29 11:27:43.751450 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 183/353] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:43 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:44.011767 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b2c2aded-88dc-4748-8451-cc2808b29d93 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:44.012408 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b2c2aded-88dc-4748-8451-cc2808b29d93 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:44.018638 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2c2aded-88dc-4748-8451-cc2808b29d93 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:44.019092 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2c2aded-88dc-4748-8451-cc2808b29d93 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:44.019886 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2c2aded-88dc-4748-8451-cc2808b29d93 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:44.020323 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2c2aded-88dc-4748-8451-cc2808b29d93 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:44.159594 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b2c2aded-88dc-4748-8451-cc2808b29d93 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:44.167195 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b2c2aded-88dc-4748-8451-cc2808b29d93 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.159382 Jun 29 11:27:44.167760 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 171/354] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:44 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:44.766504 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1790e6c4-3334-414e-bc98-f44811a4dee2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:44.767258 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1790e6c4-3334-414e-bc98-f44811a4dee2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:44.773785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1790e6c4-3334-414e-bc98-f44811a4dee2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:44.774350 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1790e6c4-3334-414e-bc98-f44811a4dee2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:44.775193 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1790e6c4-3334-414e-bc98-f44811a4dee2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:44.775701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1790e6c4-3334-414e-bc98-f44811a4dee2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:44.979310 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1790e6c4-3334-414e-bc98-f44811a4dee2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:44.992297 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1790e6c4-3334-414e-bc98-f44811a4dee2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.229543 Jun 29 11:27:44.992971 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 184/355] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:44 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:45.191256 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bfe19c75-7fd1-42d9-8fe4-8aea214db568 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:45.193272 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bfe19c75-7fd1-42d9-8fe4-8aea214db568 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:45.203066 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfe19c75-7fd1-42d9-8fe4-8aea214db568 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:45.203648 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfe19c75-7fd1-42d9-8fe4-8aea214db568 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:45.207542 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfe19c75-7fd1-42d9-8fe4-8aea214db568 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:45.208359 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfe19c75-7fd1-42d9-8fe4-8aea214db568 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:45.646541 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bfe19c75-7fd1-42d9-8fe4-8aea214db568 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:45.650263 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:45.664750 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bfe19c75-7fd1-42d9-8fe4-8aea214db568 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.473561 Jun 29 11:27:45.664750 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 172/356] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:45 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:46.021629 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b13bf38e-64ba-42c2-95f7-26947d4f630f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:46.022248 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b13bf38e-64ba-42c2-95f7-26947d4f630f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:46.028759 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b13bf38e-64ba-42c2-95f7-26947d4f630f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:46.029204 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b13bf38e-64ba-42c2-95f7-26947d4f630f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:46.030000 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b13bf38e-64ba-42c2-95f7-26947d4f630f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:46.030434 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b13bf38e-64ba-42c2-95f7-26947d4f630f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:46.180695 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b13bf38e-64ba-42c2-95f7-26947d4f630f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:46.189027 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b13bf38e-64ba-42c2-95f7-26947d4f630f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.171342 Jun 29 11:27:46.189593 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 185/357] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:46 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:46.672352 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-07f18330-7730-413f-ab15-c705b18b7533 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:46.673023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-07f18330-7730-413f-ab15-c705b18b7533 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:46.686558 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-07f18330-7730-413f-ab15-c705b18b7533 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:46.686558 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-07f18330-7730-413f-ab15-c705b18b7533 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:46.686558 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-07f18330-7730-413f-ab15-c705b18b7533 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:46.687246 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-07f18330-7730-413f-ab15-c705b18b7533 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:46.930587 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-07f18330-7730-413f-ab15-c705b18b7533 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:46.939711 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-07f18330-7730-413f-ab15-c705b18b7533 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.271162 Jun 29 11:27:46.946971 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 173/358] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:46 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:27:47.206359 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-baeec5d4-21fe-4bca-bb88-72df43f9df63 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:47.206988 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-baeec5d4-21fe-4bca-bb88-72df43f9df63 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:47.217919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baeec5d4-21fe-4bca-bb88-72df43f9df63 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:47.221058 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baeec5d4-21fe-4bca-bb88-72df43f9df63 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:47.222141 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baeec5d4-21fe-4bca-bb88-72df43f9df63 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:47.222747 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baeec5d4-21fe-4bca-bb88-72df43f9df63 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:47.433745 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-baeec5d4-21fe-4bca-bb88-72df43f9df63 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:47.444500 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-baeec5d4-21fe-4bca-bb88-72df43f9df63 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.241952 Jun 29 11:27:47.445012 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 186/359] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:47 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:47.955868 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-aa2e11c4-30ed-450c-adac-442840adfb90 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:47.956610 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-aa2e11c4-30ed-450c-adac-442840adfb90 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:47.963457 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa2e11c4-30ed-450c-adac-442840adfb90 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:47.963941 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa2e11c4-30ed-450c-adac-442840adfb90 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:47.964716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa2e11c4-30ed-450c-adac-442840adfb90 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:47.965153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa2e11c4-30ed-450c-adac-442840adfb90 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:48.100461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-aa2e11c4-30ed-450c-adac-442840adfb90 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:48.108160 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-aa2e11c4-30ed-450c-adac-442840adfb90 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.156018 Jun 29 11:27:48.108726 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 174/360] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:47 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:48.461401 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bdb03e47-6f57-4f24-ab18-a796e734d452 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:48.462034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bdb03e47-6f57-4f24-ab18-a796e734d452 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:48.469028 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bdb03e47-6f57-4f24-ab18-a796e734d452 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:48.469412 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bdb03e47-6f57-4f24-ab18-a796e734d452 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:48.470452 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bdb03e47-6f57-4f24-ab18-a796e734d452 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:48.470880 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bdb03e47-6f57-4f24-ab18-a796e734d452 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:48.619601 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bdb03e47-6f57-4f24-ab18-a796e734d452 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:48.628553 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bdb03e47-6f57-4f24-ab18-a796e734d452 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.171008 Jun 29 11:27:48.629657 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 187/361] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:48 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:49.125721 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4ca0cd80-098b-4f87-b9d6-6a6f22773861 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:49.126476 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4ca0cd80-098b-4f87-b9d6-6a6f22773861 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:49.134411 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ca0cd80-098b-4f87-b9d6-6a6f22773861 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:49.135175 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ca0cd80-098b-4f87-b9d6-6a6f22773861 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:49.136203 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ca0cd80-098b-4f87-b9d6-6a6f22773861 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:49.136847 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ca0cd80-098b-4f87-b9d6-6a6f22773861 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:49.315401 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4ca0cd80-098b-4f87-b9d6-6a6f22773861 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:49.325509 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4ca0cd80-098b-4f87-b9d6-6a6f22773861 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.204132 Jun 29 11:27:49.326086 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 175/362] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:49 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:49.646916 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-655b440d-9f12-498d-ac3e-7053fbf80bc8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:49.647525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-655b440d-9f12-498d-ac3e-7053fbf80bc8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:49.655205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-655b440d-9f12-498d-ac3e-7053fbf80bc8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:49.655666 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-655b440d-9f12-498d-ac3e-7053fbf80bc8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:49.656467 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-655b440d-9f12-498d-ac3e-7053fbf80bc8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:49.657073 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-655b440d-9f12-498d-ac3e-7053fbf80bc8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:49.691205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:49.885221 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-655b440d-9f12-498d-ac3e-7053fbf80bc8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:49.902589 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-655b440d-9f12-498d-ac3e-7053fbf80bc8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.259445 Jun 29 11:27:49.903173 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 188/363] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:49 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:50.404133 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ebfae628-8a2e-426b-ab8e-71b0f79700ab tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:50.405598 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ebfae628-8a2e-426b-ab8e-71b0f79700ab tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:50.425056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebfae628-8a2e-426b-ab8e-71b0f79700ab tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:50.425056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebfae628-8a2e-426b-ab8e-71b0f79700ab tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:50.425056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebfae628-8a2e-426b-ab8e-71b0f79700ab tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:50.425056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebfae628-8a2e-426b-ab8e-71b0f79700ab tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:50.861678 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ebfae628-8a2e-426b-ab8e-71b0f79700ab tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:50.876990 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ebfae628-8a2e-426b-ab8e-71b0f79700ab tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.476760 Jun 29 11:27:50.877827 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 176/364] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:50 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:50.923256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-03d10554-bb6b-4661-b04f-be697873eccf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:50.923989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-03d10554-bb6b-4661-b04f-be697873eccf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:50.926257 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=80 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:50.940012 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03d10554-bb6b-4661-b04f-be697873eccf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:50.940816 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03d10554-bb6b-4661-b04f-be697873eccf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:50.941797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03d10554-bb6b-4661-b04f-be697873eccf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:50.942479 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03d10554-bb6b-4661-b04f-be697873eccf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:51.227187 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-03d10554-bb6b-4661-b04f-be697873eccf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:51.242330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-03d10554-bb6b-4661-b04f-be697873eccf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.325945 Jun 29 11:27:51.246321 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 189/365] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:50 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:51.738162 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-5bfdf8af-1a90-4332-87c8-77c058f48e7f req-ce4399c5-6e93-429b-934e-88dc5bb20485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e950cf0f-7240-42de-a478-d5f963396be3", "name": "network-vif-plugged", "status": "completed", "tag": "3250b63e-97dc-4536-93b3-6a31ea96e36f"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:51.746287 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-5bfdf8af-1a90-4332-87c8-77c058f48e7f req-ce4399c5-6e93-429b-934e-88dc5bb20485 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:51.746722 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-5bfdf8af-1a90-4332-87c8-77c058f48e7f req-ce4399c5-6e93-429b-934e-88dc5bb20485 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:51.764524 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-5bfdf8af-1a90-4332-87c8-77c058f48e7f req-ce4399c5-6e93-429b-934e-88dc5bb20485 service nova] Creating event network-vif-plugged:3250b63e-97dc-4536-93b3-6a31ea96e36f for instance e950cf0f-7240-42de-a478-d5f963396be3 on hv-cinder-84733 Jun 29 11:27:51.770023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-5bfdf8af-1a90-4332-87c8-77c058f48e7f req-ce4399c5-6e93-429b-934e-88dc5bb20485 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035468 Jun 29 11:27:51.770772 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 177/366] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:27:51.903332 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8e8d0a2d-fdc0-46f4-a8b8-3bdb0c2b0b03 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:51.904040 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8e8d0a2d-fdc0-46f4-a8b8-3bdb0c2b0b03 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:51.940604 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e8d0a2d-fdc0-46f4-a8b8-3bdb0c2b0b03 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:51.944107 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e8d0a2d-fdc0-46f4-a8b8-3bdb0c2b0b03 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:51.944934 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e8d0a2d-fdc0-46f4-a8b8-3bdb0c2b0b03 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:51.945382 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e8d0a2d-fdc0-46f4-a8b8-3bdb0c2b0b03 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:52.263747 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3ad111a0-9642-488a-914a-8013729f8a17 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:52.264483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3ad111a0-9642-488a-914a-8013729f8a17 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:52.271031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ad111a0-9642-488a-914a-8013729f8a17 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:52.271332 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ad111a0-9642-488a-914a-8013729f8a17 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:52.272335 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ad111a0-9642-488a-914a-8013729f8a17 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:52.272920 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ad111a0-9642-488a-914a-8013729f8a17 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:52.657127 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8e8d0a2d-fdc0-46f4-a8b8-3bdb0c2b0b03 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:52.668500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3ad111a0-9642-488a-914a-8013729f8a17 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:52.674627 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8e8d0a2d-fdc0-46f4-a8b8-3bdb0c2b0b03 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.780233 Jun 29 11:27:52.675218 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 190/367] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:51 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:52.688419 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3ad111a0-9642-488a-914a-8013729f8a17 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.428827 Jun 29 11:27:52.690853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 178/368] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:52 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:53.692735 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7622551c-cd08-48d8-879c-5a695b08b22e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:53.693343 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7622551c-cd08-48d8-879c-5a695b08b22e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:53.700597 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7622551c-cd08-48d8-879c-5a695b08b22e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:53.701322 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7622551c-cd08-48d8-879c-5a695b08b22e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:53.702094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7622551c-cd08-48d8-879c-5a695b08b22e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:53.702529 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7622551c-cd08-48d8-879c-5a695b08b22e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:53.712767 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2ea40b62-a0cd-48e7-b5a3-03e3deb1c560 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:53.713248 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2ea40b62-a0cd-48e7-b5a3-03e3deb1c560 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:53.726574 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ea40b62-a0cd-48e7-b5a3-03e3deb1c560 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:53.730499 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ea40b62-a0cd-48e7-b5a3-03e3deb1c560 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:53.730499 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ea40b62-a0cd-48e7-b5a3-03e3deb1c560 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:53.730499 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ea40b62-a0cd-48e7-b5a3-03e3deb1c560 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:54.115345 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7622551c-cd08-48d8-879c-5a695b08b22e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:54.127492 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7622551c-cd08-48d8-879c-5a695b08b22e tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1315 microversion: 2.1 time: 0.439932 Jun 29 11:27:54.128091 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 191/369] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:53 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:54.134272 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2ea40b62-a0cd-48e7-b5a3-03e3deb1c560 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:54.143347 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2ea40b62-a0cd-48e7-b5a3-03e3deb1c560 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.435073 Jun 29 11:27:54.144030 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 179/370] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:53 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:27:54.443788 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-203e9a76-ab5e-4e3f-97ef-ade8fea3eaf4 req-ec9df3c4-cf2d-411a-9cfa-83836f1359ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3fb170-5d34-4fa4-8baa-5e404f52f4f2", "name": "network-vif-plugged", "status": "completed", "tag": "5593c143-d87b-466f-b8ca-17159064e710"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:54.452387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-203e9a76-ab5e-4e3f-97ef-ade8fea3eaf4 req-ec9df3c4-cf2d-411a-9cfa-83836f1359ae service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:54.452831 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-203e9a76-ab5e-4e3f-97ef-ade8fea3eaf4 req-ec9df3c4-cf2d-411a-9cfa-83836f1359ae service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:54.463571 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-203e9a76-ab5e-4e3f-97ef-ade8fea3eaf4 req-ec9df3c4-cf2d-411a-9cfa-83836f1359ae service nova] Creating event network-vif-plugged:5593c143-d87b-466f-b8ca-17159064e710 for instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 on hv-cinder-84733 Jun 29 11:27:54.475938 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-203e9a76-ab5e-4e3f-97ef-ade8fea3eaf4 req-ec9df3c4-cf2d-411a-9cfa-83836f1359ae service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034273 Jun 29 11:27:54.476785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 192/371] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:27:55.150260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d335df3d-d744-4ca8-8100-a94caad10086 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:55.150863 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d335df3d-d744-4ca8-8100-a94caad10086 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:55.160326 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d335df3d-d744-4ca8-8100-a94caad10086 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:55.160767 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d335df3d-d744-4ca8-8100-a94caad10086 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:55.161670 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d335df3d-d744-4ca8-8100-a94caad10086 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:55.162101 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d335df3d-d744-4ca8-8100-a94caad10086 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:55.163963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ea1d8e13-7570-42fb-8b58-7f1263f225b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:55.164673 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ea1d8e13-7570-42fb-8b58-7f1263f225b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:55.176322 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea1d8e13-7570-42fb-8b58-7f1263f225b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:55.177101 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea1d8e13-7570-42fb-8b58-7f1263f225b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:55.178053 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea1d8e13-7570-42fb-8b58-7f1263f225b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:55.178642 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea1d8e13-7570-42fb-8b58-7f1263f225b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:55.784610 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d335df3d-d744-4ca8-8100-a94caad10086 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:55.790927 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ea1d8e13-7570-42fb-8b58-7f1263f225b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:55.792866 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d335df3d-d744-4ca8-8100-a94caad10086 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1465 microversion: 2.1 time: 0.652325 Jun 29 11:27:55.799824 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 180/372] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:55 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1465 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:55.800025 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ea1d8e13-7570-42fb-8b58-7f1263f225b0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.640461 Jun 29 11:27:55.800025 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 193/373] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:55 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:55.842949 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ac883665-ac2d-42aa-9976-a5416d339592 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:55.843515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ac883665-ac2d-42aa-9976-a5416d339592 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:55.849666 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ac883665-ac2d-42aa-9976-a5416d339592 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:55.850107 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ac883665-ac2d-42aa-9976-a5416d339592 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:55.850862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ac883665-ac2d-42aa-9976-a5416d339592 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:55.851289 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ac883665-ac2d-42aa-9976-a5416d339592 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:55.878538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ac883665-ac2d-42aa-9976-a5416d339592 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:27:56.164129 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ac883665-ac2d-42aa-9976-a5416d339592 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 204 len: 0 microversion: 2.1 time: 0.324635 Jun 29 11:27:56.169444 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 181/374] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:27:55 2022] DELETE /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:27:56.177337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5761abfa-5f1f-44fb-a24f-48be18475231 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:56.178052 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5761abfa-5f1f-44fb-a24f-48be18475231 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:56.186247 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5761abfa-5f1f-44fb-a24f-48be18475231 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:56.187020 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5761abfa-5f1f-44fb-a24f-48be18475231 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:56.188319 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5761abfa-5f1f-44fb-a24f-48be18475231 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:56.188967 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5761abfa-5f1f-44fb-a24f-48be18475231 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:56.353668 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5761abfa-5f1f-44fb-a24f-48be18475231 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:56.362253 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5761abfa-5f1f-44fb-a24f-48be18475231 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1471 microversion: 2.1 time: 0.189286 Jun 29 11:27:56.362821 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 194/375] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:56 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:56.527152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a941b64d-5e6c-409a-a88d-253f9d3c37f7 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Action: 'create', calling method: .version_select at 0x7fd089fda040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2084883613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHnfv2FD8UWwkjh8ehVj5ecAYtemar1nJbKIDTS/FoFMEssjBkTS7iwvnhAGQC3JDEb33UdIpYi+bZoVLe73IoLd5QUuUfzw0VqnKXNhu1zT+dORopzXWBDY4hJTFAODQ=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:27:56.541890 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-a941b64d-5e6c-409a-a88d-253f9d3c37f7 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Getting quotas for project cdc0456bfa5a4619a96b41d3437fd82c. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:27:56.546336 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-a941b64d-5e6c-409a-a88d-253f9d3c37f7 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Getting quotas for user e91cc0b93f484f759233469ec5f37bb4 and project cdc0456bfa5a4619a96b41d3437fd82c. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:27:56.645534 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a941b64d-5e6c-409a-a88d-253f9d3c37f7 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.322181 Jun 29 11:27:56.646156 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 182/376] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jun 29 11:27:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:27:56.816198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-459737f3-980a-439d-83eb-4efcbbb44e45 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:56.816848 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-459737f3-980a-439d-83eb-4efcbbb44e45 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:56.828135 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-459737f3-980a-439d-83eb-4efcbbb44e45 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:56.828728 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-459737f3-980a-439d-83eb-4efcbbb44e45 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:56.829533 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-459737f3-980a-439d-83eb-4efcbbb44e45 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:56.831142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-459737f3-980a-439d-83eb-4efcbbb44e45 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:56.999494 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-459737f3-980a-439d-83eb-4efcbbb44e45 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:57.015530 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-459737f3-980a-439d-83eb-4efcbbb44e45 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.203157 Jun 29 11:27:57.017980 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 195/377] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:56 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:57.380109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-57bad8e0-0419-420f-b237-df8269b9b760 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:57.380876 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-57bad8e0-0419-420f-b237-df8269b9b760 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:57.387345 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57bad8e0-0419-420f-b237-df8269b9b760 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:57.387790 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57bad8e0-0419-420f-b237-df8269b9b760 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:57.389287 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57bad8e0-0419-420f-b237-df8269b9b760 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:57.389831 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57bad8e0-0419-420f-b237-df8269b9b760 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:57.562901 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-57bad8e0-0419-420f-b237-df8269b9b760 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:57.571036 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-57bad8e0-0419-420f-b237-df8269b9b760 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1471 microversion: 2.1 time: 0.194736 Jun 29 11:27:57.571642 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 183/378] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:57 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1471 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:58.034103 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b4717dfa-4689-467c-95a2-0819a3774cd0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:58.034718 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b4717dfa-4689-467c-95a2-0819a3774cd0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:58.041073 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4717dfa-4689-467c-95a2-0819a3774cd0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:58.041523 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4717dfa-4689-467c-95a2-0819a3774cd0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:58.042289 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4717dfa-4689-467c-95a2-0819a3774cd0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:58.042726 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4717dfa-4689-467c-95a2-0819a3774cd0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:58.217965 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b4717dfa-4689-467c-95a2-0819a3774cd0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:58.227299 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b4717dfa-4689-467c-95a2-0819a3774cd0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1371 microversion: 2.1 time: 0.197052 Jun 29 11:27:58.235900 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 196/379] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:58 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:58.589160 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c7321005-49c7-491d-a17f-4285679144e6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:58.589915 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c7321005-49c7-491d-a17f-4285679144e6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:58.597170 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7321005-49c7-491d-a17f-4285679144e6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:58.597675 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7321005-49c7-491d-a17f-4285679144e6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:58.598447 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7321005-49c7-491d-a17f-4285679144e6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:58.598880 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7321005-49c7-491d-a17f-4285679144e6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:58.829375 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c7321005-49c7-491d-a17f-4285679144e6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:58.840303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c7321005-49c7-491d-a17f-4285679144e6 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1471 microversion: 2.1 time: 0.254033 Jun 29 11:27:58.841081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 184/380] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:58 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1471 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:59.246415 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2569ce7-8049-4dbf-b172-6dc55d127007 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:59.247021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e2569ce7-8049-4dbf-b172-6dc55d127007 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:59.264563 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2569ce7-8049-4dbf-b172-6dc55d127007 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:59.270046 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2569ce7-8049-4dbf-b172-6dc55d127007 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:59.270046 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2569ce7-8049-4dbf-b172-6dc55d127007 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:59.270046 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2569ce7-8049-4dbf-b172-6dc55d127007 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:59.534993 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e2569ce7-8049-4dbf-b172-6dc55d127007 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:27:59.543959 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2569ce7-8049-4dbf-b172-6dc55d127007 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1565 microversion: 2.1 time: 0.301440 Jun 29 11:27:59.545317 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 197/381] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:59 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1565 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:27:59.566027 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-57a9879c-1e9f-4c69-a95e-db9944a68311 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:59.566903 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-57a9879c-1e9f-4c69-a95e-db9944a68311 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:59.575256 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57a9879c-1e9f-4c69-a95e-db9944a68311 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:59.576629 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57a9879c-1e9f-4c69-a95e-db9944a68311 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:59.577760 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57a9879c-1e9f-4c69-a95e-db9944a68311 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:59.578388 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57a9879c-1e9f-4c69-a95e-db9944a68311 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:59.673880 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-57a9879c-1e9f-4c69-a95e-db9944a68311 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116003 Jun 29 11:27:59.678871 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 185/382] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jun 29 11:27:59 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:27:59.860324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa88c48f-7aee-4762-917e-dc9936e514bc tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:27:59.861551 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aa88c48f-7aee-4762-917e-dc9936e514bc tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:27:59.869324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa88c48f-7aee-4762-917e-dc9936e514bc tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:59.871610 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa88c48f-7aee-4762-917e-dc9936e514bc tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:27:59.872554 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa88c48f-7aee-4762-917e-dc9936e514bc tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:27:59.874716 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa88c48f-7aee-4762-917e-dc9936e514bc tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:00.266080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa88c48f-7aee-4762-917e-dc9936e514bc tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:00.276777 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aa88c48f-7aee-4762-917e-dc9936e514bc tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1471 microversion: 2.1 time: 0.421259 Jun 29 11:28:00.277862 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 198/383] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:27:59 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1471 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:01.296181 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f73d2010-d71b-419a-85ae-b49d16b68b34 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:01.296181 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f73d2010-d71b-419a-85ae-b49d16b68b34 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:01.305806 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f73d2010-d71b-419a-85ae-b49d16b68b34 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:01.306585 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f73d2010-d71b-419a-85ae-b49d16b68b34 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:01.308328 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f73d2010-d71b-419a-85ae-b49d16b68b34 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:01.310454 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f73d2010-d71b-419a-85ae-b49d16b68b34 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:01.530870 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f73d2010-d71b-419a-85ae-b49d16b68b34 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:01.533925 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f73d2010-d71b-419a-85ae-b49d16b68b34 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1429 microversion: 2.1 time: 0.244272 Jun 29 11:28:01.546879 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-9161061b-1a54-40d6-a2ca-ebfe242605a3 req-7cbc50fe-4b4a-40ae-9e7f-83ac5c1a6a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e950cf0f-7240-42de-a478-d5f963396be3", "name": "network-vif-deleted", "tag": "3250b63e-97dc-4536-93b3-6a31ea96e36f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:28:01.548776 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 186/384] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:01 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1429 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:01.556117 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9161061b-1a54-40d6-a2ca-ebfe242605a3 req-7cbc50fe-4b4a-40ae-9e7f-83ac5c1a6a92 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:01.556963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9161061b-1a54-40d6-a2ca-ebfe242605a3 req-7cbc50fe-4b4a-40ae-9e7f-83ac5c1a6a92 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:01.573262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-9161061b-1a54-40d6-a2ca-ebfe242605a3 req-7cbc50fe-4b4a-40ae-9e7f-83ac5c1a6a92 service nova] Creating event network-vif-deleted:3250b63e-97dc-4536-93b3-6a31ea96e36f for instance e950cf0f-7240-42de-a478-d5f963396be3 on hv-cinder-84733 Jun 29 11:28:01.580481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-9161061b-1a54-40d6-a2ca-ebfe242605a3 req-7cbc50fe-4b4a-40ae-9e7f-83ac5c1a6a92 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040718 Jun 29 11:28:01.582275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 199/385] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:28:02.551812 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d3f450e6-15e1-46fc-933f-575801f28583 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:02.552436 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d3f450e6-15e1-46fc-933f-575801f28583 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:02.581851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3f450e6-15e1-46fc-933f-575801f28583 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:02.583503 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3f450e6-15e1-46fc-933f-575801f28583 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:02.584678 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3f450e6-15e1-46fc-933f-575801f28583 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:02.585361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3f450e6-15e1-46fc-933f-575801f28583 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:02.637199 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3f450e6-15e1-46fc-933f-575801f28583 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:02.637735 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3f450e6-15e1-46fc-933f-575801f28583 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:02.638241 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-d3f450e6-15e1-46fc-933f-575801f28583 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lazy-loading 'fault' on Instance uuid e950cf0f-7240-42de-a478-d5f963396be3 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:28:02.686341 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d3f450e6-15e1-46fc-933f-575801f28583 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907e9be3b1f54f17b8e3841130d41cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7653e362c7d49a3ae386f137c41889c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:02.691007 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d3f450e6-15e1-46fc-933f-575801f28583 tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 200 len: 1305 microversion: 2.1 time: 0.142765 Jun 29 11:28:02.691355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 187/386] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:02 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 1305 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:03.598476 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-4954cacc-d1a0-4365-9cd8-130d3667b3bd req-9a1af2bb-0591-474e-b166-df53f31de424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3fb170-5d34-4fa4-8baa-5e404f52f4f2", "tag": "5593c143-d87b-466f-b8ca-17159064e710"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:28:03.634583 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4954cacc-d1a0-4365-9cd8-130d3667b3bd req-9a1af2bb-0591-474e-b166-df53f31de424 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:03.635878 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4954cacc-d1a0-4365-9cd8-130d3667b3bd req-9a1af2bb-0591-474e-b166-df53f31de424 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:03.654459 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-4954cacc-d1a0-4365-9cd8-130d3667b3bd req-9a1af2bb-0591-474e-b166-df53f31de424 service nova] Creating event network-changed:5593c143-d87b-466f-b8ca-17159064e710 for instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 on hv-cinder-84733 Jun 29 11:28:03.663152 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-4954cacc-d1a0-4365-9cd8-130d3667b3bd req-9a1af2bb-0591-474e-b166-df53f31de424 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070273 Jun 29 11:28:03.665432 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 200/387] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:28:03.708177 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-30b0d736-8628-4024-9a3a-80970924707f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:03.709498 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-30b0d736-8628-4024-9a3a-80970924707f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] [instance: e950cf0f-7240-42de-a478-d5f963396be3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:03.716187 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30b0d736-8628-4024-9a3a-80970924707f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:03.717025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30b0d736-8628-4024-9a3a-80970924707f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:03.718270 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30b0d736-8628-4024-9a3a-80970924707f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:03.718916 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30b0d736-8628-4024-9a3a-80970924707f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:03.744400 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-30b0d736-8628-4024-9a3a-80970924707f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] HTTP exception thrown: Instance e950cf0f-7240-42de-a478-d5f963396be3 could not be found. Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-30b0d736-8628-4024-9a3a-80970924707f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Request method failure captured: Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 HTTP/1.1 Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDcPrS4wUq-FFTpKID-hv0__naBMHZE7eiDdVtmpTNjfwODIL7VPSi7t-QYOUQhsChXVUa8R1DUFU95_U0tMQ44zatEvX-as214MtICycakm-Eoj-snohbtlDiduye8X_pXWGBqwkjYCgvvdSMA8FvvbVJhzjB3q_NLldfGJIrJg-ks Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: c7653e362c7d49a3ae386f137c41889c Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesNegativeTest-1270142403 Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:28:03.747080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:28:03.748992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c7653e362c7d49a3ae386f137c41889c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c7653e362c7d49a3ae386f137c41889c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c7653e362c7d49a3ae386f137c41889c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c7653e362c7d49a3ae386f137c41889c"}]}] Jun 29 11:28:03.748992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesNegativeTest-1270142403 Jun 29 11:28:03.748992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: c7653e362c7d49a3ae386f137c41889c Jun 29 11:28:03.748992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesNegativeTest-1270142403 Jun 29 11:28:03.748992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesNegativeTest-1270142403-project Jun 29 11:28:03.748992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:28:03.748992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:28:03.748992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 907e9be3b1f54f17b8e3841130d41cc7 Jun 29 11:28:03.748992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesNegativeTest-1270142403-project Jun 29 11:28:03.748992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:28:03.748992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance e950cf0f-7240-42de-a478-d5f963396be3 could not be found. Jun 29 11:28:03.748992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': 'e950cf0f-7240-42de-a478-d5f963396be3'} Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e950cf0f-7240-42de-a478-d5f963396be3 could not be found. Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:28:03.749716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e950cf0f-7240-42de-a478-d5f963396be3 could not be found. Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e950cf0f-7240-42de-a478-d5f963396be3 could not be found. Jun 29 11:28:03.750912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:28:03.753400 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-30b0d736-8628-4024-9a3a-80970924707f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] Returning 404 to user: Instance e950cf0f-7240-42de-a478-d5f963396be3 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:28:03.754483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-30b0d736-8628-4024-9a3a-80970924707f tempest-VolumesNegativeTest-1270142403 tempest-VolumesNegativeTest-1270142403-project] 10.222.0.44 "GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3" status: 404 len: 111 microversion: 2.1 time: 0.050303 Jun 29 11:28:03.759454 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 188/388] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:03 2022] GET /compute/v2.1/servers/e950cf0f-7240-42de-a478-d5f963396be3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:28:16.916935 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=23 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:16.916935 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=63 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:16.918673 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8502926b-afca-4231-8d6e-d0aeb5de1eab tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:16.919367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8502926b-afca-4231-8d6e-d0aeb5de1eab tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:16.926056 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8502926b-afca-4231-8d6e-d0aeb5de1eab tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:16.926503 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8502926b-afca-4231-8d6e-d0aeb5de1eab tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:16.927271 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8502926b-afca-4231-8d6e-d0aeb5de1eab tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:16.927701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8502926b-afca-4231-8d6e-d0aeb5de1eab tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:16.958859 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8502926b-afca-4231-8d6e-d0aeb5de1eab tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/ips" status: 200 len: 146 microversion: 2.1 time: 0.051547 Jun 29 11:28:16.959443 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 201/389] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jun 29 11:28:16 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:28:20.565780 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fb4face1-8624-40e4-8155-567d4ff690f8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd2552d9-eb1a-45dd-9cb3-027e75cd9092"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:28:20.566869 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fb4face1-8624-40e4-8155-567d4ff690f8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:20.576005 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=4 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:20.576841 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:20.577660 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:20.581500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb4face1-8624-40e4-8155-567d4ff690f8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:20.581959 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb4face1-8624-40e4-8155-567d4ff690f8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:20.582745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb4face1-8624-40e4-8155-567d4ff690f8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:20.583187 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb4face1-8624-40e4-8155-567d4ff690f8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:21.484702 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fb4face1-8624-40e4-8155-567d4ff690f8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "POST /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.925891 Jun 29 11:28:21.485585 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 189/390] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:28:20 2022] POST /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/os-volume_attachments => generated 194 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:28:24.080219 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f7fb007e-777a-41a4-81fc-7d6938992a3a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Action: 'create', calling method: .version_select at 0x7fd08ab431f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-923554176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9U+E5tbNlGiSlgtN3EtoL5BLw1Y5EwWSKElCR7P+MonJzdmWb6cIEMFw8Es4YCksernOu7qrgOnNFqoyY2zIespcGH1dtAaByYDf1fODnG8dWJ9tdCmoxs3b1uTdVyWQ=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:28:24.094066 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-f7fb007e-777a-41a4-81fc-7d6938992a3a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Getting quotas for project 58aac09bb66b4f98abf47ae8bd863203. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:28:24.098056 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-f7fb007e-777a-41a4-81fc-7d6938992a3a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Getting quotas for user 1158e0283f3643669448ca4281e7b1fa and project 58aac09bb66b4f98abf47ae8bd863203. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:28:24.172292 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f7fb007e-777a-41a4-81fc-7d6938992a3a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.096669 Jun 29 11:28:24.172804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 202/391] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jun 29 11:28:24 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:28:24.221908 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-779765042", "imageRef": "9b8eb3f2-6dca-41d3-9610-45d1280a6ce7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-923554176", "networks": [{"uuid": "b6ce4017-3559-43d2-b045-748870706fbf"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:28:24.275689 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] validate_networks() for [('b6ce4017-3559-43d2-b045-748870706fbf', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:28:24.644216 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:28:24.644633 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:28:24.645129 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:28:24.645531 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:28:24.645939 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:28:24.655289 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:24.655732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:24.656631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:24.657066 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:24.673239 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Getting quotas for project 58aac09bb66b4f98abf47ae8bd863203. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:28:24.677172 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Getting quotas for user 1158e0283f3643669448ca4281e7b1fa and project 58aac09bb66b4f98abf47ae8bd863203. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:28:24.688266 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:28:24.690542 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b8eb3f2-6dca-41d3-9610-45d1280a6ce7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:28:24.806669 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5c47ef49-7f74-4fa5-8b49-84b6b2250ab0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590190 Jun 29 11:28:24.810735 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 190/392] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:28:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:28:24.817498 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2099bd15-4498-4207-8098-b979a1f0315c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:24.818228 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2099bd15-4498-4207-8098-b979a1f0315c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:24.880623 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2099bd15-4498-4207-8098-b979a1f0315c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:24.889309 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2099bd15-4498-4207-8098-b979a1f0315c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1257 microversion: 2.1 time: 0.075637 Jun 29 11:28:24.889877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 203/393] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:24 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1257 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:25.905693 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d1a747d0-5440-4644-b419-9722a1d5a27f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:25.906305 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d1a747d0-5440-4644-b419-9722a1d5a27f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:25.913279 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1a747d0-5440-4644-b419-9722a1d5a27f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:25.913729 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1a747d0-5440-4644-b419-9722a1d5a27f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:25.914490 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1a747d0-5440-4644-b419-9722a1d5a27f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:25.914927 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1a747d0-5440-4644-b419-9722a1d5a27f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:25.976858 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d1a747d0-5440-4644-b419-9722a1d5a27f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:25.984584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d1a747d0-5440-4644-b419-9722a1d5a27f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1261 microversion: 2.1 time: 0.083213 Jun 29 11:28:25.985134 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 191/394] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:25 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:27.000402 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a87a852-73c2-4c43-896e-6d0ac3443205 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:27.001015 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a87a852-73c2-4c43-896e-6d0ac3443205 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:27.008411 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a87a852-73c2-4c43-896e-6d0ac3443205 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:27.008858 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a87a852-73c2-4c43-896e-6d0ac3443205 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:27.009613 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a87a852-73c2-4c43-896e-6d0ac3443205 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:27.010044 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a87a852-73c2-4c43-896e-6d0ac3443205 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:27.068746 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a87a852-73c2-4c43-896e-6d0ac3443205 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:27.076526 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a87a852-73c2-4c43-896e-6d0ac3443205 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1261 microversion: 2.1 time: 0.079956 Jun 29 11:28:27.077085 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 204/395] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:26 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:28.093641 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d8991790-a489-4327-a7e8-df55765231aa tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:28.094271 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d8991790-a489-4327-a7e8-df55765231aa tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:28.100970 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8991790-a489-4327-a7e8-df55765231aa tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:28.101408 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8991790-a489-4327-a7e8-df55765231aa tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:28.102152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8991790-a489-4327-a7e8-df55765231aa tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:28.102579 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8991790-a489-4327-a7e8-df55765231aa tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:28.160943 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d8991790-a489-4327-a7e8-df55765231aa tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:28.168106 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d8991790-a489-4327-a7e8-df55765231aa tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1261 microversion: 2.1 time: 0.078758 Jun 29 11:28:28.168644 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 192/396] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:28 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1261 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:29.186014 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8a23cd7f-2d2b-4866-9e56-c5a91e648783 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:29.186619 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8a23cd7f-2d2b-4866-9e56-c5a91e648783 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:29.193227 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a23cd7f-2d2b-4866-9e56-c5a91e648783 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:29.193614 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a23cd7f-2d2b-4866-9e56-c5a91e648783 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:29.194363 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a23cd7f-2d2b-4866-9e56-c5a91e648783 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:29.194796 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a23cd7f-2d2b-4866-9e56-c5a91e648783 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:29.257920 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a23cd7f-2d2b-4866-9e56-c5a91e648783 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:29.265455 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8a23cd7f-2d2b-4866-9e56-c5a91e648783 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1309 microversion: 2.1 time: 0.083934 Jun 29 11:28:29.266021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 205/397] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:29 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1309 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:30.283125 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d5e36516-5769-42e5-a35b-e151b329a104 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:30.283844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d5e36516-5769-42e5-a35b-e151b329a104 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:30.299713 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5e36516-5769-42e5-a35b-e151b329a104 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:30.306055 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5e36516-5769-42e5-a35b-e151b329a104 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:30.306055 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5e36516-5769-42e5-a35b-e151b329a104 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:30.306055 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5e36516-5769-42e5-a35b-e151b329a104 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:30.504140 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d5e36516-5769-42e5-a35b-e151b329a104 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:30.511719 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d5e36516-5769-42e5-a35b-e151b329a104 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.232816 Jun 29 11:28:30.520064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 193/398] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:30 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:31.531069 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-baf91a71-3c12-4347-9cd5-98d3f1295fbd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:31.531668 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-baf91a71-3c12-4347-9cd5-98d3f1295fbd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:31.538178 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baf91a71-3c12-4347-9cd5-98d3f1295fbd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:31.538656 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baf91a71-3c12-4347-9cd5-98d3f1295fbd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:31.539385 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baf91a71-3c12-4347-9cd5-98d3f1295fbd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:31.539890 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baf91a71-3c12-4347-9cd5-98d3f1295fbd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:31.697277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-baf91a71-3c12-4347-9cd5-98d3f1295fbd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:31.705604 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-baf91a71-3c12-4347-9cd5-98d3f1295fbd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.178982 Jun 29 11:28:31.706168 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 206/399] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:31 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:32.723315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5a97063c-4ad2-4bde-b9de-4d6164225240 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:32.723944 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5a97063c-4ad2-4bde-b9de-4d6164225240 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:32.730404 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a97063c-4ad2-4bde-b9de-4d6164225240 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:32.730843 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a97063c-4ad2-4bde-b9de-4d6164225240 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:32.731606 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a97063c-4ad2-4bde-b9de-4d6164225240 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:32.732644 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a97063c-4ad2-4bde-b9de-4d6164225240 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:32.878163 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5a97063c-4ad2-4bde-b9de-4d6164225240 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:32.885730 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5a97063c-4ad2-4bde-b9de-4d6164225240 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.166476 Jun 29 11:28:32.886291 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 194/400] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:32 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:33.902915 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8659feaa-d314-48db-8f17-ad6bb345faeb tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:33.904234 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8659feaa-d314-48db-8f17-ad6bb345faeb tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:33.911265 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8659feaa-d314-48db-8f17-ad6bb345faeb tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:33.911822 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8659feaa-d314-48db-8f17-ad6bb345faeb tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:33.912876 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8659feaa-d314-48db-8f17-ad6bb345faeb tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:33.913533 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8659feaa-d314-48db-8f17-ad6bb345faeb tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:34.054068 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8659feaa-d314-48db-8f17-ad6bb345faeb tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:34.062358 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8659feaa-d314-48db-8f17-ad6bb345faeb tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.163544 Jun 29 11:28:34.063604 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 207/401] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:33 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:35.076709 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:35.077807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:35.081296 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-802455c2-a863-4df3-92be-5c55edae22bc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:35.081901 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-802455c2-a863-4df3-92be-5c55edae22bc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:35.087749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-802455c2-a863-4df3-92be-5c55edae22bc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:35.088226 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-802455c2-a863-4df3-92be-5c55edae22bc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:35.088980 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-802455c2-a863-4df3-92be-5c55edae22bc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:35.089413 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-802455c2-a863-4df3-92be-5c55edae22bc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:35.275430 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-802455c2-a863-4df3-92be-5c55edae22bc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:35.275430 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-802455c2-a863-4df3-92be-5c55edae22bc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.170040 Jun 29 11:28:35.275430 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 195/402] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:35 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:36.285981 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-59ce48bf-122a-4468-98ed-6497638bf79c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:36.286594 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-59ce48bf-122a-4468-98ed-6497638bf79c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:36.290897 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:36.294847 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59ce48bf-122a-4468-98ed-6497638bf79c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:36.295296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59ce48bf-122a-4468-98ed-6497638bf79c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:36.296115 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59ce48bf-122a-4468-98ed-6497638bf79c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:36.296641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59ce48bf-122a-4468-98ed-6497638bf79c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:36.454337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59ce48bf-122a-4468-98ed-6497638bf79c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:36.462467 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-59ce48bf-122a-4468-98ed-6497638bf79c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.180958 Jun 29 11:28:36.463330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 208/403] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:36 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:37.481035 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-34a6e02f-af22-4548-b4ad-5121afc532f3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:37.481711 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-34a6e02f-af22-4548-b4ad-5121afc532f3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:37.489201 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34a6e02f-af22-4548-b4ad-5121afc532f3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:37.489644 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34a6e02f-af22-4548-b4ad-5121afc532f3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:37.490395 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34a6e02f-af22-4548-b4ad-5121afc532f3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:37.490837 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34a6e02f-af22-4548-b4ad-5121afc532f3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:37.644649 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-34a6e02f-af22-4548-b4ad-5121afc532f3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:37.652151 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-34a6e02f-af22-4548-b4ad-5121afc532f3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.175455 Jun 29 11:28:37.652705 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 196/404] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:37 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:28:38.057621 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1540057598", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2084883613", "security_groups": [{"name": "tempest-secgroup-smoke-254433816"}], "block_device_mapping_v2": [{"uuid": "ae1fe5d9-acee-4c2c-a7b6-1361a573bcea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "565f4274-f756-4c7f-9d43-992c92750ab4"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:28:38.176796 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] validate_networks() for [('565f4274-f756-4c7f-9d43-992c92750ab4', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:28:38.581833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:28:38.582466 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:28:38.582943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:28:38.583352 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:28:38.583763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:28:38.593511 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:38.594015 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:38.594960 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:38.595623 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:38.616659 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Getting quotas for project cdc0456bfa5a4619a96b41d3437fd82c. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:28:38.620615 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Getting quotas for user e91cc0b93f484f759233469ec5f37bb4 and project cdc0456bfa5a4619a96b41d3437fd82c. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:28:38.672743 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-248d1a9f-d0bf-4730-b30e-df6cc335fb31 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:38.673355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-248d1a9f-d0bf-4730-b30e-df6cc335fb31 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:38.678331 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:28:38.680756 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae1fe5d9-acee-4c2c-a7b6-1361a573bcea',volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:28:38.681286 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-248d1a9f-d0bf-4730-b30e-df6cc335fb31 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:38.681949 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-248d1a9f-d0bf-4730-b30e-df6cc335fb31 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:38.682921 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-248d1a9f-d0bf-4730-b30e-df6cc335fb31 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:38.683654 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-248d1a9f-d0bf-4730-b30e-df6cc335fb31 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:38.820012 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-248d1a9f-d0bf-4730-b30e-df6cc335fb31 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:38.827951 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-248d1a9f-d0bf-4730-b30e-df6cc335fb31 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.161176 Jun 29 11:28:38.828526 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 197/405] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:38 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:28:39.119970 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9c5cb8ab-1544-4cb4-9868-918d56371434 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.066122 Jun 29 11:28:39.120652 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 209/406] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:28:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 11:28:39.131230 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-073d55e6-908a-4248-b71b-14124c42b483 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:39.131873 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-073d55e6-908a-4248-b71b-14124c42b483 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:39.184989 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-073d55e6-908a-4248-b71b-14124c42b483 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:39.199550 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-073d55e6-908a-4248-b71b-14124c42b483 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1095 microversion: 2.1 time: 0.072855 Jun 29 11:28:39.212529 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 198/407] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:39 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1095 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:39.845233 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b41d0761-e1a3-4957-a09f-2f81773374be tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:39.845758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b41d0761-e1a3-4957-a09f-2f81773374be tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:39.853257 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b41d0761-e1a3-4957-a09f-2f81773374be tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:39.853698 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b41d0761-e1a3-4957-a09f-2f81773374be tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:39.854447 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b41d0761-e1a3-4957-a09f-2f81773374be tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:39.854870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b41d0761-e1a3-4957-a09f-2f81773374be tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:40.013371 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b41d0761-e1a3-4957-a09f-2f81773374be tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:40.021051 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b41d0761-e1a3-4957-a09f-2f81773374be tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.179951 Jun 29 11:28:40.021620 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 210/408] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:39 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:28:40.229524 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6c5104c5-274e-4137-8fb4-f5652895c545 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:40.230210 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6c5104c5-274e-4137-8fb4-f5652895c545 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:40.302530 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6c5104c5-274e-4137-8fb4-f5652895c545 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:40.310484 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6c5104c5-274e-4137-8fb4-f5652895c545 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1095 microversion: 2.1 time: 0.085092 Jun 29 11:28:40.311047 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 199/409] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:40 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1095 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:41.038837 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c71866eb-dd2a-4220-b640-1b48f501b164 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:41.039635 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c71866eb-dd2a-4220-b640-1b48f501b164 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:41.046107 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c71866eb-dd2a-4220-b640-1b48f501b164 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:41.046849 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c71866eb-dd2a-4220-b640-1b48f501b164 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:41.047609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c71866eb-dd2a-4220-b640-1b48f501b164 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:41.048117 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c71866eb-dd2a-4220-b640-1b48f501b164 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:41.189149 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c71866eb-dd2a-4220-b640-1b48f501b164 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:41.197171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c71866eb-dd2a-4220-b640-1b48f501b164 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.163174 Jun 29 11:28:41.197745 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 211/410] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:41 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:41.327409 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7d022b22-d6bf-4a2c-a6f1-2a31370cf9de tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:41.328050 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7d022b22-d6bf-4a2c-a6f1-2a31370cf9de tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:41.334650 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7d022b22-d6bf-4a2c-a6f1-2a31370cf9de tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:41.335101 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7d022b22-d6bf-4a2c-a6f1-2a31370cf9de tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:41.335917 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7d022b22-d6bf-4a2c-a6f1-2a31370cf9de tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:41.336357 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7d022b22-d6bf-4a2c-a6f1-2a31370cf9de tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:41.398417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7d022b22-d6bf-4a2c-a6f1-2a31370cf9de tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:41.405971 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7d022b22-d6bf-4a2c-a6f1-2a31370cf9de tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1145 microversion: 2.1 time: 0.082295 Jun 29 11:28:41.406539 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 200/411] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:41 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:42.213862 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02214b33-b39e-4fbb-925c-b09789dd6e7e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:42.214474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02214b33-b39e-4fbb-925c-b09789dd6e7e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:42.221340 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02214b33-b39e-4fbb-925c-b09789dd6e7e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:42.221809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02214b33-b39e-4fbb-925c-b09789dd6e7e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:42.222577 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02214b33-b39e-4fbb-925c-b09789dd6e7e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:42.223013 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02214b33-b39e-4fbb-925c-b09789dd6e7e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:42.360067 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02214b33-b39e-4fbb-925c-b09789dd6e7e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:42.368604 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-02214b33-b39e-4fbb-925c-b09789dd6e7e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.158510 Jun 29 11:28:42.369180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 212/412] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:42 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:42.422366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-33ef2d50-b947-464d-b092-d1b2dd9f847f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:42.423619 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-33ef2d50-b947-464d-b092-d1b2dd9f847f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:42.430672 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-33ef2d50-b947-464d-b092-d1b2dd9f847f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:42.431110 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-33ef2d50-b947-464d-b092-d1b2dd9f847f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:42.432104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-33ef2d50-b947-464d-b092-d1b2dd9f847f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:42.432577 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-33ef2d50-b947-464d-b092-d1b2dd9f847f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:42.500653 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-33ef2d50-b947-464d-b092-d1b2dd9f847f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:42.509052 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-33ef2d50-b947-464d-b092-d1b2dd9f847f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1145 microversion: 2.1 time: 0.090392 Jun 29 11:28:42.509921 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 201/413] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:42 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:43.385875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ea399391-fb7c-4ac5-9f75-1483b3e45633 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:43.386471 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ea399391-fb7c-4ac5-9f75-1483b3e45633 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:43.392859 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea399391-fb7c-4ac5-9f75-1483b3e45633 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:43.393793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea399391-fb7c-4ac5-9f75-1483b3e45633 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:43.394545 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea399391-fb7c-4ac5-9f75-1483b3e45633 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:43.394981 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea399391-fb7c-4ac5-9f75-1483b3e45633 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:43.523308 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ea399391-fb7c-4ac5-9f75-1483b3e45633 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:43.525775 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-674d2eac-666e-4ef1-b54d-40858d37ee63 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:43.526376 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-674d2eac-666e-4ef1-b54d-40858d37ee63 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:43.530817 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ea399391-fb7c-4ac5-9f75-1483b3e45633 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.148730 Jun 29 11:28:43.539171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 213/414] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:43 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:43.539302 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-674d2eac-666e-4ef1-b54d-40858d37ee63 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:43.539302 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-674d2eac-666e-4ef1-b54d-40858d37ee63 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:43.539302 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-674d2eac-666e-4ef1-b54d-40858d37ee63 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:43.539302 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-674d2eac-666e-4ef1-b54d-40858d37ee63 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:43.595390 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-674d2eac-666e-4ef1-b54d-40858d37ee63 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:43.602972 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-674d2eac-666e-4ef1-b54d-40858d37ee63 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1145 microversion: 2.1 time: 0.081024 Jun 29 11:28:43.603516 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 202/415] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:43 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:28:44.548291 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1981f5e6-0044-474f-8691-df39f3938d3f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:44.548901 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1981f5e6-0044-474f-8691-df39f3938d3f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:44.555975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1981f5e6-0044-474f-8691-df39f3938d3f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:44.556422 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1981f5e6-0044-474f-8691-df39f3938d3f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:44.557169 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1981f5e6-0044-474f-8691-df39f3938d3f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:44.557598 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1981f5e6-0044-474f-8691-df39f3938d3f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:44.619601 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-110cff58-eca4-44c2-9ee9-2e32b2097d42 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:44.620862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-110cff58-eca4-44c2-9ee9-2e32b2097d42 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:44.627423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-110cff58-eca4-44c2-9ee9-2e32b2097d42 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:44.627904 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-110cff58-eca4-44c2-9ee9-2e32b2097d42 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:44.628675 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-110cff58-eca4-44c2-9ee9-2e32b2097d42 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:44.629109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-110cff58-eca4-44c2-9ee9-2e32b2097d42 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:44.703112 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-110cff58-eca4-44c2-9ee9-2e32b2097d42 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:44.710944 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-110cff58-eca4-44c2-9ee9-2e32b2097d42 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1145 microversion: 2.1 time: 0.095246 Jun 29 11:28:44.711503 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 203/416] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:44 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:28:44.719821 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1981f5e6-0044-474f-8691-df39f3938d3f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:44.728090 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1981f5e6-0044-474f-8691-df39f3938d3f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.183625 Jun 29 11:28:44.728645 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 214/417] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:44 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:45.727958 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4c374502-9176-4910-b9e4-90212ca8e398 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:45.728558 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4c374502-9176-4910-b9e4-90212ca8e398 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:45.735230 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c374502-9176-4910-b9e4-90212ca8e398 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:45.735669 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c374502-9176-4910-b9e4-90212ca8e398 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:45.736443 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c374502-9176-4910-b9e4-90212ca8e398 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:45.737375 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c374502-9176-4910-b9e4-90212ca8e398 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:45.744573 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3234dbf9-80f7-4069-aeb9-a4819f205c2d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:45.745181 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3234dbf9-80f7-4069-aeb9-a4819f205c2d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:45.751507 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3234dbf9-80f7-4069-aeb9-a4819f205c2d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:45.751985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3234dbf9-80f7-4069-aeb9-a4819f205c2d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:45.753392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3234dbf9-80f7-4069-aeb9-a4819f205c2d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:45.753820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3234dbf9-80f7-4069-aeb9-a4819f205c2d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:45.799912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4c374502-9176-4910-b9e4-90212ca8e398 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:45.807352 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4c374502-9176-4910-b9e4-90212ca8e398 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1145 microversion: 2.1 time: 0.083343 Jun 29 11:28:45.807946 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 204/418] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:45 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:45.890886 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3234dbf9-80f7-4069-aeb9-a4819f205c2d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:45.898281 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3234dbf9-80f7-4069-aeb9-a4819f205c2d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.157468 Jun 29 11:28:45.902104 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 215/419] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:45 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:28:46.823989 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c15eb193-92f5-4c31-ac0f-fced2e74a611 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:46.824595 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c15eb193-92f5-4c31-ac0f-fced2e74a611 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:46.831774 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c15eb193-92f5-4c31-ac0f-fced2e74a611 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:46.832246 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c15eb193-92f5-4c31-ac0f-fced2e74a611 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:46.832997 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c15eb193-92f5-4c31-ac0f-fced2e74a611 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:46.833429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c15eb193-92f5-4c31-ac0f-fced2e74a611 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:46.905220 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c15eb193-92f5-4c31-ac0f-fced2e74a611 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:46.905421 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c15eb193-92f5-4c31-ac0f-fced2e74a611 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1145 microversion: 2.1 time: 0.085273 Jun 29 11:28:46.905932 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 205/420] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:46 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:46.925908 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7a6cbdee-a7aa-45f9-8985-bb6cc198c2d4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:46.926478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7a6cbdee-a7aa-45f9-8985-bb6cc198c2d4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:46.934571 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a6cbdee-a7aa-45f9-8985-bb6cc198c2d4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:46.935035 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a6cbdee-a7aa-45f9-8985-bb6cc198c2d4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:46.935806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a6cbdee-a7aa-45f9-8985-bb6cc198c2d4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:46.936255 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a6cbdee-a7aa-45f9-8985-bb6cc198c2d4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:47.066044 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7a6cbdee-a7aa-45f9-8985-bb6cc198c2d4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:47.073369 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7a6cbdee-a7aa-45f9-8985-bb6cc198c2d4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.151882 Jun 29 11:28:47.073937 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 216/421] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:46 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:47.925746 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8f18887b-8126-498f-8ba6-66882a194820 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:47.926343 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8f18887b-8126-498f-8ba6-66882a194820 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:47.932728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f18887b-8126-498f-8ba6-66882a194820 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:47.933170 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f18887b-8126-498f-8ba6-66882a194820 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:47.933919 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f18887b-8126-498f-8ba6-66882a194820 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:47.934345 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f18887b-8126-498f-8ba6-66882a194820 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:47.994221 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8f18887b-8126-498f-8ba6-66882a194820 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:47.997691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:48.001926 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8f18887b-8126-498f-8ba6-66882a194820 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1145 microversion: 2.1 time: 0.080014 Jun 29 11:28:48.002508 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 206/422] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:47 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:48.090154 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-836d3870-ac82-425c-8ef8-c95a6084e0c7 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:48.090765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-836d3870-ac82-425c-8ef8-c95a6084e0c7 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:48.097437 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-836d3870-ac82-425c-8ef8-c95a6084e0c7 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:48.098635 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-836d3870-ac82-425c-8ef8-c95a6084e0c7 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:48.099758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-836d3870-ac82-425c-8ef8-c95a6084e0c7 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:48.100250 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-836d3870-ac82-425c-8ef8-c95a6084e0c7 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:48.226996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-836d3870-ac82-425c-8ef8-c95a6084e0c7 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:48.234236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-836d3870-ac82-425c-8ef8-c95a6084e0c7 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.147872 Jun 29 11:28:48.234787 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 217/423] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:48 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:49.018785 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-573cc272-81a4-448c-9783-865e48739d5a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:49.019148 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-573cc272-81a4-448c-9783-865e48739d5a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:49.026168 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-573cc272-81a4-448c-9783-865e48739d5a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:49.026606 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-573cc272-81a4-448c-9783-865e48739d5a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:49.027363 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-573cc272-81a4-448c-9783-865e48739d5a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:49.027787 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-573cc272-81a4-448c-9783-865e48739d5a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:49.090129 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-573cc272-81a4-448c-9783-865e48739d5a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:49.099751 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-573cc272-81a4-448c-9783-865e48739d5a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1145 microversion: 2.1 time: 0.085147 Jun 29 11:28:49.100748 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 207/424] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:49 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:49.250538 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a4c2b1fe-242b-4744-af92-9d7699fb1994 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:49.251159 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a4c2b1fe-242b-4744-af92-9d7699fb1994 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:49.253016 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:49.253679 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:49.258879 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4c2b1fe-242b-4744-af92-9d7699fb1994 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:49.259328 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4c2b1fe-242b-4744-af92-9d7699fb1994 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:49.260130 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4c2b1fe-242b-4744-af92-9d7699fb1994 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:49.260565 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4c2b1fe-242b-4744-af92-9d7699fb1994 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:49.391806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a4c2b1fe-242b-4744-af92-9d7699fb1994 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:49.399677 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a4c2b1fe-242b-4744-af92-9d7699fb1994 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.153002 Jun 29 11:28:49.400270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 218/425] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:49 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:50.117674 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d4afc68c-bbce-4242-8a72-6156d8b6a5dd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:50.118288 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d4afc68c-bbce-4242-8a72-6156d8b6a5dd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:50.131532 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4afc68c-bbce-4242-8a72-6156d8b6a5dd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:50.133293 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4afc68c-bbce-4242-8a72-6156d8b6a5dd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:50.134329 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4afc68c-bbce-4242-8a72-6156d8b6a5dd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:50.136447 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4afc68c-bbce-4242-8a72-6156d8b6a5dd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:50.213587 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d4afc68c-bbce-4242-8a72-6156d8b6a5dd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:50.221504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d4afc68c-bbce-4242-8a72-6156d8b6a5dd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1193 microversion: 2.1 time: 0.107680 Jun 29 11:28:50.222073 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 208/426] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:50 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1193 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:50.316556 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-ec897fe5-6115-46dc-9b95-b2c4b17f20f0 req-b27fe2bf-e4fe-4840-b082-c2d523e21b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514fe8ac-ed28-4fb6-8f17-c9e43d34e032", "tag": "fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:28:50.329509 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ec897fe5-6115-46dc-9b95-b2c4b17f20f0 req-b27fe2bf-e4fe-4840-b082-c2d523e21b7d service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:50.329779 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ec897fe5-6115-46dc-9b95-b2c4b17f20f0 req-b27fe2bf-e4fe-4840-b082-c2d523e21b7d service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:50.342683 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-ec897fe5-6115-46dc-9b95-b2c4b17f20f0 req-b27fe2bf-e4fe-4840-b082-c2d523e21b7d service nova] Creating event network-changed:fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3 for instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 on hv-cinder-84733 Jun 29 11:28:50.348393 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-ec897fe5-6115-46dc-9b95-b2c4b17f20f0 req-b27fe2bf-e4fe-4840-b082-c2d523e21b7d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035876 Jun 29 11:28:50.352059 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 219/427] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:28:50.417570 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f6c10eb1-7518-47ab-8ae9-086db5e4d084 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:50.418181 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f6c10eb1-7518-47ab-8ae9-086db5e4d084 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:50.420143 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=4 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:50.425658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6c10eb1-7518-47ab-8ae9-086db5e4d084 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:50.426099 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6c10eb1-7518-47ab-8ae9-086db5e4d084 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:50.426866 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6c10eb1-7518-47ab-8ae9-086db5e4d084 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:50.427299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6c10eb1-7518-47ab-8ae9-086db5e4d084 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:50.559240 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f6c10eb1-7518-47ab-8ae9-086db5e4d084 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:50.568618 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f6c10eb1-7518-47ab-8ae9-086db5e4d084 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.155205 Jun 29 11:28:50.569765 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 209/428] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:50 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:28:51.239500 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6900fa7e-73de-4fad-8ed6-45fd45e45c82 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:51.240246 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6900fa7e-73de-4fad-8ed6-45fd45e45c82 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:51.247976 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6900fa7e-73de-4fad-8ed6-45fd45e45c82 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:51.248438 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6900fa7e-73de-4fad-8ed6-45fd45e45c82 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:51.249216 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6900fa7e-73de-4fad-8ed6-45fd45e45c82 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:51.249655 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6900fa7e-73de-4fad-8ed6-45fd45e45c82 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:51.381545 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6900fa7e-73de-4fad-8ed6-45fd45e45c82 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:51.393636 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6900fa7e-73de-4fad-8ed6-45fd45e45c82 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1211 microversion: 2.1 time: 0.158153 Jun 29 11:28:51.394224 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 220/429] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:51 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1211 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:51.587488 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-25489267-9648-4c3d-9e0e-4ad5136e4cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:51.588259 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-25489267-9648-4c3d-9e0e-4ad5136e4cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:51.597014 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:51.601918 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25489267-9648-4c3d-9e0e-4ad5136e4cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:51.601918 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25489267-9648-4c3d-9e0e-4ad5136e4cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:51.601918 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25489267-9648-4c3d-9e0e-4ad5136e4cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:51.602260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25489267-9648-4c3d-9e0e-4ad5136e4cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:51.836353 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-25489267-9648-4c3d-9e0e-4ad5136e4cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:51.844022 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-25489267-9648-4c3d-9e0e-4ad5136e4cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.261385 Jun 29 11:28:51.844618 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 210/430] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:51 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:52.412392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-892f93db-98e3-4fd9-b348-1da453f9b989 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:52.413416 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-892f93db-98e3-4fd9-b348-1da453f9b989 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:52.444618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-892f93db-98e3-4fd9-b348-1da453f9b989 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:52.445112 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-892f93db-98e3-4fd9-b348-1da453f9b989 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:52.445900 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-892f93db-98e3-4fd9-b348-1da453f9b989 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:52.446341 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-892f93db-98e3-4fd9-b348-1da453f9b989 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:52.452285 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:52.593711 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-892f93db-98e3-4fd9-b348-1da453f9b989 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:52.601573 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-892f93db-98e3-4fd9-b348-1da453f9b989 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1278 microversion: 2.1 time: 0.194240 Jun 29 11:28:52.602136 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 221/431] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:52 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:52.869076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-269b7058-421b-4339-a941-e7f8d5aea85e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:52.870282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-269b7058-421b-4339-a941-e7f8d5aea85e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:52.876643 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-269b7058-421b-4339-a941-e7f8d5aea85e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:52.882103 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-269b7058-421b-4339-a941-e7f8d5aea85e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:52.882103 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-269b7058-421b-4339-a941-e7f8d5aea85e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:52.882103 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-269b7058-421b-4339-a941-e7f8d5aea85e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:53.009040 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-269b7058-421b-4339-a941-e7f8d5aea85e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:53.016589 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-269b7058-421b-4339-a941-e7f8d5aea85e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.151511 Jun 29 11:28:53.017152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 211/432] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:52 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:53.618444 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-840a642b-b34e-40c7-93f2-8f82a19836f9 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:53.619056 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-840a642b-b34e-40c7-93f2-8f82a19836f9 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:53.625493 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-840a642b-b34e-40c7-93f2-8f82a19836f9 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:53.625939 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-840a642b-b34e-40c7-93f2-8f82a19836f9 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:53.626696 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-840a642b-b34e-40c7-93f2-8f82a19836f9 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:53.627129 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-840a642b-b34e-40c7-93f2-8f82a19836f9 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:53.758763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-840a642b-b34e-40c7-93f2-8f82a19836f9 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:53.766114 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-840a642b-b34e-40c7-93f2-8f82a19836f9 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1278 microversion: 2.1 time: 0.151535 Jun 29 11:28:53.766677 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 222/433] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:53 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:54.033122 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c6b93f54-d587-4eb1-aacf-5de1fdde466d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:54.033721 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c6b93f54-d587-4eb1-aacf-5de1fdde466d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:54.040165 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6b93f54-d587-4eb1-aacf-5de1fdde466d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:54.056920 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6b93f54-d587-4eb1-aacf-5de1fdde466d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:54.056920 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6b93f54-d587-4eb1-aacf-5de1fdde466d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:54.056920 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6b93f54-d587-4eb1-aacf-5de1fdde466d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:54.173766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c6b93f54-d587-4eb1-aacf-5de1fdde466d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:54.181235 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c6b93f54-d587-4eb1-aacf-5de1fdde466d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.152009 Jun 29 11:28:54.181797 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 212/434] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:54 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:54.782877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4e250694-1962-487d-8b86-f9b16ad3ffa7 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:54.783499 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4e250694-1962-487d-8b86-f9b16ad3ffa7 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:54.786374 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:54.790993 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e250694-1962-487d-8b86-f9b16ad3ffa7 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:54.791437 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e250694-1962-487d-8b86-f9b16ad3ffa7 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:54.792245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e250694-1962-487d-8b86-f9b16ad3ffa7 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:54.792679 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e250694-1962-487d-8b86-f9b16ad3ffa7 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:54.921673 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4e250694-1962-487d-8b86-f9b16ad3ffa7 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:54.930771 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4e250694-1962-487d-8b86-f9b16ad3ffa7 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1278 microversion: 2.1 time: 0.151735 Jun 29 11:28:54.931341 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 223/435] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:54 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:55.197716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-58d7febd-160d-4e7c-9b34-82fea94ac3e0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:55.198344 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-58d7febd-160d-4e7c-9b34-82fea94ac3e0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:55.204732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58d7febd-160d-4e7c-9b34-82fea94ac3e0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:55.205096 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58d7febd-160d-4e7c-9b34-82fea94ac3e0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:55.205846 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58d7febd-160d-4e7c-9b34-82fea94ac3e0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:55.206276 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58d7febd-160d-4e7c-9b34-82fea94ac3e0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:55.390377 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-58d7febd-160d-4e7c-9b34-82fea94ac3e0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:55.405558 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-58d7febd-160d-4e7c-9b34-82fea94ac3e0 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.211530 Jun 29 11:28:55.406334 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 213/436] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:55 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:55.949999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-67d07d2a-8f4d-4b1b-9579-25315a8f03be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:55.950693 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-67d07d2a-8f4d-4b1b-9579-25315a8f03be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:55.959326 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67d07d2a-8f4d-4b1b-9579-25315a8f03be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:55.960092 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67d07d2a-8f4d-4b1b-9579-25315a8f03be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:55.960875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67d07d2a-8f4d-4b1b-9579-25315a8f03be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:55.961311 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67d07d2a-8f4d-4b1b-9579-25315a8f03be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:56.113976 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-67d07d2a-8f4d-4b1b-9579-25315a8f03be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:56.121300 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-67d07d2a-8f4d-4b1b-9579-25315a8f03be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1278 microversion: 2.1 time: 0.176450 Jun 29 11:28:56.126422 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 224/437] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:55 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:56.198850 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-1d27c5ea-9ddf-4346-a3db-48426cdd0a77 req-d1315f0e-6266-4642-a6fc-4901f3b248fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d99b83-36d5-48e9-9557-95e6f29f9f7e", "tag": "839607fb-10e5-4eaf-a58d-d39ced8e7b5a"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:28:56.208234 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1d27c5ea-9ddf-4346-a3db-48426cdd0a77 req-d1315f0e-6266-4642-a6fc-4901f3b248fb service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:56.209253 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1d27c5ea-9ddf-4346-a3db-48426cdd0a77 req-d1315f0e-6266-4642-a6fc-4901f3b248fb service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:56.221075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-1d27c5ea-9ddf-4346-a3db-48426cdd0a77 req-d1315f0e-6266-4642-a6fc-4901f3b248fb service nova] Creating event network-changed:839607fb-10e5-4eaf-a58d-d39ced8e7b5a for instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e on hv-cinder-84733 Jun 29 11:28:56.226806 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-1d27c5ea-9ddf-4346-a3db-48426cdd0a77 req-d1315f0e-6266-4642-a6fc-4901f3b248fb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031727 Jun 29 11:28:56.230764 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 214/438] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:28:56.429815 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7cfe2ac2-a0cb-4a5e-952b-ca6dfb227346 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:56.430506 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7cfe2ac2-a0cb-4a5e-952b-ca6dfb227346 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:56.439222 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cfe2ac2-a0cb-4a5e-952b-ca6dfb227346 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:56.439677 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cfe2ac2-a0cb-4a5e-952b-ca6dfb227346 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:56.446802 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cfe2ac2-a0cb-4a5e-952b-ca6dfb227346 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:56.446802 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cfe2ac2-a0cb-4a5e-952b-ca6dfb227346 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:56.701508 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7cfe2ac2-a0cb-4a5e-952b-ca6dfb227346 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:56.718488 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7cfe2ac2-a0cb-4a5e-952b-ca6dfb227346 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.284960 Jun 29 11:28:56.718488 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 225/439] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:56 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:57.142290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1eb27646-ae93-4e29-acd9-c6ab90ce1aea tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:57.143027 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1eb27646-ae93-4e29-acd9-c6ab90ce1aea tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:57.157810 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1eb27646-ae93-4e29-acd9-c6ab90ce1aea tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:57.157810 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1eb27646-ae93-4e29-acd9-c6ab90ce1aea tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:57.157810 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1eb27646-ae93-4e29-acd9-c6ab90ce1aea tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:57.157810 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1eb27646-ae93-4e29-acd9-c6ab90ce1aea tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:57.380271 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1eb27646-ae93-4e29-acd9-c6ab90ce1aea tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:57.388477 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1eb27646-ae93-4e29-acd9-c6ab90ce1aea tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1278 microversion: 2.1 time: 0.253073 Jun 29 11:28:57.389038 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 215/440] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:57 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1278 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:57.629829 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-32274e79-6523-4b22-9819-892dbde51e85 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:28:57.647656 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32274e79-6523-4b22-9819-892dbde51e85 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:57.647656 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32274e79-6523-4b22-9819-892dbde51e85 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:57.706140 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-32274e79-6523-4b22-9819-892dbde51e85 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Going to try to stop instance {{(pid=117920) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 29 11:28:57.727337 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dc63931f-5cdd-47e9-b730-1d2b753d710d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:57.728090 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dc63931f-5cdd-47e9-b730-1d2b753d710d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:57.734107 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dc63931f-5cdd-47e9-b730-1d2b753d710d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:57.734542 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dc63931f-5cdd-47e9-b730-1d2b753d710d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:57.735292 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dc63931f-5cdd-47e9-b730-1d2b753d710d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:57.735717 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dc63931f-5cdd-47e9-b730-1d2b753d710d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:57.871029 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dc63931f-5cdd-47e9-b730-1d2b753d710d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:57.878798 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dc63931f-5cdd-47e9-b730-1d2b753d710d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.155905 Jun 29 11:28:57.879361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 216/441] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:57 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:28:57.890019 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-32274e79-6523-4b22-9819-892dbde51e85 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "POST /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/action" status: 202 len: 0 microversion: 2.1 time: 0.269742 Jun 29 11:28:57.892090 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 226/442] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:28:57 2022] POST /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:28:57.898463 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3dce08bc-b597-4c06-82aa-55bc5a553c0e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:57.899071 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3dce08bc-b597-4c06-82aa-55bc5a553c0e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:57.905285 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3dce08bc-b597-4c06-82aa-55bc5a553c0e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:57.905730 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3dce08bc-b597-4c06-82aa-55bc5a553c0e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:57.906516 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3dce08bc-b597-4c06-82aa-55bc5a553c0e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:57.906948 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3dce08bc-b597-4c06-82aa-55bc5a553c0e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:58.055690 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3dce08bc-b597-4c06-82aa-55bc5a553c0e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:58.063564 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3dce08bc-b597-4c06-82aa-55bc5a553c0e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.168867 Jun 29 11:28:58.069109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 217/443] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:57 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:58.405813 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e97a60ed-200d-4f5f-bb18-e0924fc6dfbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:58.406515 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e97a60ed-200d-4f5f-bb18-e0924fc6dfbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:58.413431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e97a60ed-200d-4f5f-bb18-e0924fc6dfbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:58.413865 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e97a60ed-200d-4f5f-bb18-e0924fc6dfbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:58.414628 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e97a60ed-200d-4f5f-bb18-e0924fc6dfbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:58.415082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e97a60ed-200d-4f5f-bb18-e0924fc6dfbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:58.557831 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e97a60ed-200d-4f5f-bb18-e0924fc6dfbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:58.565235 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e97a60ed-200d-4f5f-bb18-e0924fc6dfbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1278 microversion: 2.1 time: 0.163614 Jun 29 11:28:58.565805 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 227/444] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:58 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:58.608840 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-ee284f99-d788-4e33-8b31-80c73f314d0a req-7379648e-a233-4bb1-9141-da39e520d1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514fe8ac-ed28-4fb6-8f17-c9e43d34e032", "name": "network-vif-plugged", "status": "completed", "tag": "fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:28:58.617715 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ee284f99-d788-4e33-8b31-80c73f314d0a req-7379648e-a233-4bb1-9141-da39e520d1ec service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:58.618166 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ee284f99-d788-4e33-8b31-80c73f314d0a req-7379648e-a233-4bb1-9141-da39e520d1ec service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:58.630291 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-ee284f99-d788-4e33-8b31-80c73f314d0a req-7379648e-a233-4bb1-9141-da39e520d1ec service nova] Creating event network-vif-plugged:fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3 for instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 on hv-cinder-84733 Jun 29 11:28:58.635247 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-ee284f99-d788-4e33-8b31-80c73f314d0a req-7379648e-a233-4bb1-9141-da39e520d1ec service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030069 Jun 29 11:28:58.635852 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 218/445] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:28:58.895469 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d290a89d-dd9a-4d45-8604-b1f19c9f0047 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:58.896206 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d290a89d-dd9a-4d45-8604-b1f19c9f0047 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:58.902645 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d290a89d-dd9a-4d45-8604-b1f19c9f0047 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:58.903188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d290a89d-dd9a-4d45-8604-b1f19c9f0047 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:58.904058 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d290a89d-dd9a-4d45-8604-b1f19c9f0047 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:58.904496 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d290a89d-dd9a-4d45-8604-b1f19c9f0047 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:59.056000 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d290a89d-dd9a-4d45-8604-b1f19c9f0047 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:59.063314 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d290a89d-dd9a-4d45-8604-b1f19c9f0047 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.171690 Jun 29 11:28:59.063966 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 228/446] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:58 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:59.082777 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-07176378-6322-4f76-971c-ed25bba6b864 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:59.083474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-07176378-6322-4f76-971c-ed25bba6b864 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:59.089549 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-07176378-6322-4f76-971c-ed25bba6b864 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:59.089995 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-07176378-6322-4f76-971c-ed25bba6b864 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:59.090934 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-07176378-6322-4f76-971c-ed25bba6b864 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:59.091370 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-07176378-6322-4f76-971c-ed25bba6b864 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:59.225063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-07176378-6322-4f76-971c-ed25bba6b864 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:59.233020 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-07176378-6322-4f76-971c-ed25bba6b864 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.154395 Jun 29 11:28:59.233571 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 219/447] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:59 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:28:59.581631 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-42b2198a-f8c0-44c8-9d96-76227e97b357 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:28:59.582867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-42b2198a-f8c0-44c8-9d96-76227e97b357 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:28:59.588873 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42b2198a-f8c0-44c8-9d96-76227e97b357 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:59.589320 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42b2198a-f8c0-44c8-9d96-76227e97b357 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:59.590123 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42b2198a-f8c0-44c8-9d96-76227e97b357 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:28:59.590553 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42b2198a-f8c0-44c8-9d96-76227e97b357 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:28:59.728097 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-42b2198a-f8c0-44c8-9d96-76227e97b357 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:28:59.735717 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-42b2198a-f8c0-44c8-9d96-76227e97b357 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.157887 Jun 29 11:28:59.736309 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 229/448] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:28:59 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:00.080234 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cc92709e-81ac-4c8d-ba16-d81f27fe6635 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:00.080871 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cc92709e-81ac-4c8d-ba16-d81f27fe6635 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:00.088124 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc92709e-81ac-4c8d-ba16-d81f27fe6635 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:00.093600 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc92709e-81ac-4c8d-ba16-d81f27fe6635 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:00.093600 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc92709e-81ac-4c8d-ba16-d81f27fe6635 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:00.093600 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc92709e-81ac-4c8d-ba16-d81f27fe6635 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:00.250414 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e7fc04aa-3208-433e-8786-139a727f3711 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:00.251079 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e7fc04aa-3208-433e-8786-139a727f3711 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:00.257362 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7fc04aa-3208-433e-8786-139a727f3711 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:00.257804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7fc04aa-3208-433e-8786-139a727f3711 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:00.258552 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7fc04aa-3208-433e-8786-139a727f3711 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:00.258981 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7fc04aa-3208-433e-8786-139a727f3711 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:00.266398 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cc92709e-81ac-4c8d-ba16-d81f27fe6635 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:00.273689 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cc92709e-81ac-4c8d-ba16-d81f27fe6635 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.197344 Jun 29 11:29:00.274249 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 220/449] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:00 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:00.404337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e7fc04aa-3208-433e-8786-139a727f3711 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:00.412845 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e7fc04aa-3208-433e-8786-139a727f3711 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.166271 Jun 29 11:29:00.413418 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 230/450] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:00 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:29:00.755263 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-478469b1-4cea-4f4f-ae58-91557e72e51a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:00.755897 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-478469b1-4cea-4f4f-ae58-91557e72e51a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:00.761830 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-478469b1-4cea-4f4f-ae58-91557e72e51a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:00.762264 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-478469b1-4cea-4f4f-ae58-91557e72e51a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:00.763012 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-478469b1-4cea-4f4f-ae58-91557e72e51a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:00.763435 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-478469b1-4cea-4f4f-ae58-91557e72e51a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:00.890634 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-478469b1-4cea-4f4f-ae58-91557e72e51a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:00.897978 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-478469b1-4cea-4f4f-ae58-91557e72e51a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.147879 Jun 29 11:29:00.898572 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 221/451] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:00 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:01.290807 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-864db49e-acb8-4015-894f-23aee582e56e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:01.291409 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-864db49e-acb8-4015-894f-23aee582e56e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:01.297885 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-864db49e-acb8-4015-894f-23aee582e56e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:01.298330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-864db49e-acb8-4015-894f-23aee582e56e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:01.299082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-864db49e-acb8-4015-894f-23aee582e56e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:01.299513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-864db49e-acb8-4015-894f-23aee582e56e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:01.427846 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-864db49e-acb8-4015-894f-23aee582e56e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:01.429798 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e3195e77-402c-4986-856c-cdcc2ae943b8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:01.430401 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e3195e77-402c-4986-856c-cdcc2ae943b8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:01.435559 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-864db49e-acb8-4015-894f-23aee582e56e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1357 microversion: 2.1 time: 0.148665 Jun 29 11:29:01.436155 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 231/452] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:01 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:01.436829 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3195e77-402c-4986-856c-cdcc2ae943b8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:01.437274 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3195e77-402c-4986-856c-cdcc2ae943b8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:01.438027 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3195e77-402c-4986-856c-cdcc2ae943b8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:01.438454 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3195e77-402c-4986-856c-cdcc2ae943b8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:01.566888 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e3195e77-402c-4986-856c-cdcc2ae943b8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:01.574993 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e3195e77-402c-4986-856c-cdcc2ae943b8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.149031 Jun 29 11:29:01.575550 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 222/453] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:01 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:01.914617 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-408c7e25-0406-4432-a9f8-5e6294cf7c7a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:01.915332 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-408c7e25-0406-4432-a9f8-5e6294cf7c7a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:01.921396 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-408c7e25-0406-4432-a9f8-5e6294cf7c7a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:01.921837 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-408c7e25-0406-4432-a9f8-5e6294cf7c7a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:01.922587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-408c7e25-0406-4432-a9f8-5e6294cf7c7a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:01.923029 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-408c7e25-0406-4432-a9f8-5e6294cf7c7a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:02.059813 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-408c7e25-0406-4432-a9f8-5e6294cf7c7a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:02.067779 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-408c7e25-0406-4432-a9f8-5e6294cf7c7a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.157089 Jun 29 11:29:02.068371 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 232/454] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:01 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:02.452685 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eacf0dc6-3712-4ac7-98cc-995ecbf5f26e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:02.453320 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eacf0dc6-3712-4ac7-98cc-995ecbf5f26e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:02.460047 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eacf0dc6-3712-4ac7-98cc-995ecbf5f26e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:02.460488 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eacf0dc6-3712-4ac7-98cc-995ecbf5f26e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:02.461239 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eacf0dc6-3712-4ac7-98cc-995ecbf5f26e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:02.461666 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eacf0dc6-3712-4ac7-98cc-995ecbf5f26e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:02.587260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eacf0dc6-3712-4ac7-98cc-995ecbf5f26e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:02.592138 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2a600fa9-6257-4f10-9a77-97cec97c0cd2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:02.592735 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2a600fa9-6257-4f10-9a77-97cec97c0cd2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:02.594803 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eacf0dc6-3712-4ac7-98cc-995ecbf5f26e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1546 microversion: 2.1 time: 0.146080 Jun 29 11:29:02.595371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 223/455] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:02 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1546 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:02.599824 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a600fa9-6257-4f10-9a77-97cec97c0cd2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:02.600286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a600fa9-6257-4f10-9a77-97cec97c0cd2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:02.601036 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a600fa9-6257-4f10-9a77-97cec97c0cd2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:02.601462 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a600fa9-6257-4f10-9a77-97cec97c0cd2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:02.611958 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4c769341-9666-4b90-a817-f09dda236f41 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:02.612701 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4c769341-9666-4b90-a817-f09dda236f41 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:02.619272 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c769341-9666-4b90-a817-f09dda236f41 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:02.619714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c769341-9666-4b90-a817-f09dda236f41 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:02.620537 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c769341-9666-4b90-a817-f09dda236f41 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:02.620970 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c769341-9666-4b90-a817-f09dda236f41 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:02.809086 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2a600fa9-6257-4f10-9a77-97cec97c0cd2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:02.815621 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4c769341-9666-4b90-a817-f09dda236f41 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:02.817028 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2a600fa9-6257-4f10-9a77-97cec97c0cd2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.228996 Jun 29 11:29:02.819464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 233/456] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:02 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:29:02.819580 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:29:02.823646 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4c769341-9666-4b90-a817-f09dda236f41 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1546 microversion: 2.1 time: 0.215519 Jun 29 11:29:02.824223 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 224/457] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:02 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1546 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:29:02.840012 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-014f0b82-74df-4805-8036-069a009c234d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:02.843842 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-014f0b82-74df-4805-8036-069a009c234d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:02.848401 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-014f0b82-74df-4805-8036-069a009c234d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Searching by: {'deleted': False, 'project_id': '58aac09bb66b4f98abf47ae8bd863203'} {{(pid=117920) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 29 11:29:02.852346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-014f0b82-74df-4805-8036-069a009c234d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:02.852797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-014f0b82-74df-4805-8036-069a009c234d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:02.853590 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-014f0b82-74df-4805-8036-069a009c234d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:02.854028 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-014f0b82-74df-4805-8036-069a009c234d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:02.945364 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.multi_cell_list [None req-014f0b82-74df-4805-8036-069a009c234d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 29 11:29:03.039715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-014f0b82-74df-4805-8036-069a009c234d tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203875 Jun 29 11:29:03.040325 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 234/458] 10.222.0.44 () {58 vars in 1124 bytes} [Wed Jun 29 11:29:02 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:29:03.050939 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-53b2d972-7c20-4df8-ba04-99c6136b02d1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:03.051546 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-53b2d972-7c20-4df8-ba04-99c6136b02d1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:03.057790 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53b2d972-7c20-4df8-ba04-99c6136b02d1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:03.058173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53b2d972-7c20-4df8-ba04-99c6136b02d1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:03.058914 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53b2d972-7c20-4df8-ba04-99c6136b02d1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:03.059342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53b2d972-7c20-4df8-ba04-99c6136b02d1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:03.084957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f880561c-0880-43d7-bed3-7d5bd1a17a87 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:03.085621 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f880561c-0880-43d7-bed3-7d5bd1a17a87 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:03.091399 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f880561c-0880-43d7-bed3-7d5bd1a17a87 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:03.091870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f880561c-0880-43d7-bed3-7d5bd1a17a87 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:03.092631 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f880561c-0880-43d7-bed3-7d5bd1a17a87 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:03.093063 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f880561c-0880-43d7-bed3-7d5bd1a17a87 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:03.248408 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-53b2d972-7c20-4df8-ba04-99c6136b02d1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:03.256500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-53b2d972-7c20-4df8-ba04-99c6136b02d1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1546 microversion: 2.1 time: 0.209764 Jun 29 11:29:03.257071 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 225/459] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:03 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1546 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:03.276538 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f880561c-0880-43d7-bed3-7d5bd1a17a87 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:03.284271 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f880561c-0880-43d7-bed3-7d5bd1a17a87 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.203631 Jun 29 11:29:03.291872 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 235/460] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:03 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:29:03.834133 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d843ae06-63df-4f58-bde2-741b4d43b6a4 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:03.834728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d843ae06-63df-4f58-bde2-741b4d43b6a4 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:03.841409 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d843ae06-63df-4f58-bde2-741b4d43b6a4 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:03.841869 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d843ae06-63df-4f58-bde2-741b4d43b6a4 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:03.842658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d843ae06-63df-4f58-bde2-741b4d43b6a4 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:03.843186 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d843ae06-63df-4f58-bde2-741b4d43b6a4 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:03.980781 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d843ae06-63df-4f58-bde2-741b4d43b6a4 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:03.988672 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d843ae06-63df-4f58-bde2-741b4d43b6a4 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.158424 Jun 29 11:29:03.992961 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 226/461] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:03 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:04.300974 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-38eb3539-364e-444b-81e9-0f75315892d1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:04.301654 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-38eb3539-364e-444b-81e9-0f75315892d1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:04.308174 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38eb3539-364e-444b-81e9-0f75315892d1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:04.308620 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38eb3539-364e-444b-81e9-0f75315892d1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:04.309374 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38eb3539-364e-444b-81e9-0f75315892d1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:04.309813 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38eb3539-364e-444b-81e9-0f75315892d1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:04.327700 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:29:04.654745 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38eb3539-364e-444b-81e9-0f75315892d1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:04.662096 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-38eb3539-364e-444b-81e9-0f75315892d1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.364963 Jun 29 11:29:04.662649 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 236/462] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:04 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:05.006616 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5990f035-6b5b-4c7d-bcd6-f7f4741e28a5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:05.007216 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5990f035-6b5b-4c7d-bcd6-f7f4741e28a5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:05.013605 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5990f035-6b5b-4c7d-bcd6-f7f4741e28a5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:05.014049 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5990f035-6b5b-4c7d-bcd6-f7f4741e28a5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:05.014794 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5990f035-6b5b-4c7d-bcd6-f7f4741e28a5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:05.015221 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5990f035-6b5b-4c7d-bcd6-f7f4741e28a5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:05.139722 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5990f035-6b5b-4c7d-bcd6-f7f4741e28a5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:05.147566 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5990f035-6b5b-4c7d-bcd6-f7f4741e28a5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.145585 Jun 29 11:29:05.148164 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 227/463] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:05 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:05.682556 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-28c3ef97-b5d8-4481-b181-ebb19afb85f6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:05.683110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-28c3ef97-b5d8-4481-b181-ebb19afb85f6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:05.689532 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28c3ef97-b5d8-4481-b181-ebb19afb85f6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:05.689974 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28c3ef97-b5d8-4481-b181-ebb19afb85f6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:05.690727 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28c3ef97-b5d8-4481-b181-ebb19afb85f6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:05.691162 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28c3ef97-b5d8-4481-b181-ebb19afb85f6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:05.820710 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-28c3ef97-b5d8-4481-b181-ebb19afb85f6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:05.827978 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-28c3ef97-b5d8-4481-b181-ebb19afb85f6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.149277 Jun 29 11:29:05.828536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 237/464] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:05 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:06.164866 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-847d1c0d-a5a0-49f0-8be3-8042437da0f2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:06.165532 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-847d1c0d-a5a0-49f0-8be3-8042437da0f2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:06.172064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-847d1c0d-a5a0-49f0-8be3-8042437da0f2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:06.172520 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-847d1c0d-a5a0-49f0-8be3-8042437da0f2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:06.173306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-847d1c0d-a5a0-49f0-8be3-8042437da0f2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:06.173747 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-847d1c0d-a5a0-49f0-8be3-8042437da0f2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:06.298458 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-847d1c0d-a5a0-49f0-8be3-8042437da0f2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:06.306770 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-847d1c0d-a5a0-49f0-8be3-8042437da0f2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.146240 Jun 29 11:29:06.307336 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 228/465] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:06 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:06.845705 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d9a730d-d2b1-428a-951b-2161fc01a92e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:06.846240 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0d9a730d-d2b1-428a-951b-2161fc01a92e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:06.853551 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d9a730d-d2b1-428a-951b-2161fc01a92e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:06.856022 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d9a730d-d2b1-428a-951b-2161fc01a92e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:06.856022 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d9a730d-d2b1-428a-951b-2161fc01a92e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:06.856022 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d9a730d-d2b1-428a-951b-2161fc01a92e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:06.983928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0d9a730d-d2b1-428a-951b-2161fc01a92e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:06.992257 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0d9a730d-d2b1-428a-951b-2161fc01a92e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.150388 Jun 29 11:29:06.997978 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 238/466] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:06 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:07.323745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-abe76715-1828-4281-818c-7f874bd3faf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:07.324569 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-abe76715-1828-4281-818c-7f874bd3faf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:07.331184 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-abe76715-1828-4281-818c-7f874bd3faf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:07.331693 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-abe76715-1828-4281-818c-7f874bd3faf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:07.332543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-abe76715-1828-4281-818c-7f874bd3faf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:07.333618 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-abe76715-1828-4281-818c-7f874bd3faf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:07.467500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-abe76715-1828-4281-818c-7f874bd3faf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:07.477593 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-abe76715-1828-4281-818c-7f874bd3faf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.157427 Jun 29 11:29:07.478161 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 229/467] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:07 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:08.009264 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d84951c9-0c03-4360-8119-e5ab12700005 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:08.009874 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d84951c9-0c03-4360-8119-e5ab12700005 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:08.016481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d84951c9-0c03-4360-8119-e5ab12700005 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:08.016933 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d84951c9-0c03-4360-8119-e5ab12700005 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:08.017697 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d84951c9-0c03-4360-8119-e5ab12700005 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:08.018133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d84951c9-0c03-4360-8119-e5ab12700005 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:08.150228 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d84951c9-0c03-4360-8119-e5ab12700005 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:08.157573 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d84951c9-0c03-4360-8119-e5ab12700005 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.152766 Jun 29 11:29:08.158145 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 239/468] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:08 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:08.221311 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7aa9fe93-fd06-4c87-ab3a-11794c2052a4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63ad26be-d38d-4d1f-a6a2-4fd382e15331"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:29:08.222717 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7aa9fe93-fd06-4c87-ab3a-11794c2052a4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:08.229348 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7aa9fe93-fd06-4c87-ab3a-11794c2052a4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:08.229798 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7aa9fe93-fd06-4c87-ab3a-11794c2052a4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:08.230587 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7aa9fe93-fd06-4c87-ab3a-11794c2052a4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:08.231024 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7aa9fe93-fd06-4c87-ab3a-11794c2052a4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:08.494900 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5c5d6b4a-10e7-4b62-9025-144455912fbd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:08.495536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5c5d6b4a-10e7-4b62-9025-144455912fbd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:08.501573 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c5d6b4a-10e7-4b62-9025-144455912fbd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:08.502021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c5d6b4a-10e7-4b62-9025-144455912fbd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:08.502785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c5d6b4a-10e7-4b62-9025-144455912fbd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:08.503216 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c5d6b4a-10e7-4b62-9025-144455912fbd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:08.636073 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5c5d6b4a-10e7-4b62-9025-144455912fbd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:08.643969 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5c5d6b4a-10e7-4b62-9025-144455912fbd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.153648 Jun 29 11:29:08.644533 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 240/469] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:08 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:29:09.025366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7aa9fe93-fd06-4c87-ab3a-11794c2052a4 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "POST /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.807873 Jun 29 11:29:09.025994 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 230/470] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:29:08 2022] POST /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments => generated 194 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:29:09.174198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3d3880a9-a9c2-4643-848a-57308ae6f2be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:09.175367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3d3880a9-a9c2-4643-848a-57308ae6f2be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:09.185727 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d3880a9-a9c2-4643-848a-57308ae6f2be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:09.187059 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d3880a9-a9c2-4643-848a-57308ae6f2be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:09.188495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d3880a9-a9c2-4643-848a-57308ae6f2be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:09.189536 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d3880a9-a9c2-4643-848a-57308ae6f2be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:09.334641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3d3880a9-a9c2-4643-848a-57308ae6f2be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:09.342193 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3d3880a9-a9c2-4643-848a-57308ae6f2be tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.171794 Jun 29 11:29:09.342765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 241/471] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:09 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:09.662277 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c86cf7a2-8eb6-48bd-910b-ed09d0902958 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:09.662975 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c86cf7a2-8eb6-48bd-910b-ed09d0902958 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:09.669657 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c86cf7a2-8eb6-48bd-910b-ed09d0902958 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:09.670097 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c86cf7a2-8eb6-48bd-910b-ed09d0902958 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:09.670851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c86cf7a2-8eb6-48bd-910b-ed09d0902958 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:09.671283 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c86cf7a2-8eb6-48bd-910b-ed09d0902958 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:09.801418 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c86cf7a2-8eb6-48bd-910b-ed09d0902958 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:09.809953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c86cf7a2-8eb6-48bd-910b-ed09d0902958 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.152282 Jun 29 11:29:09.810446 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 231/472] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:09 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:10.358322 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6cca6e13-25f9-4da2-a587-869d09a8de5c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:10.358870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6cca6e13-25f9-4da2-a587-869d09a8de5c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:10.365308 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6cca6e13-25f9-4da2-a587-869d09a8de5c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:10.365744 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6cca6e13-25f9-4da2-a587-869d09a8de5c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:10.366550 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6cca6e13-25f9-4da2-a587-869d09a8de5c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:10.366984 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6cca6e13-25f9-4da2-a587-869d09a8de5c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:10.590099 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6cca6e13-25f9-4da2-a587-869d09a8de5c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:10.590099 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6cca6e13-25f9-4da2-a587-869d09a8de5c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.172270 Jun 29 11:29:10.590099 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 242/473] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:10 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:10.826676 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2fbbab79-727c-462d-b973-f788becbece5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:10.827351 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2fbbab79-727c-462d-b973-f788becbece5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:10.833771 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2fbbab79-727c-462d-b973-f788becbece5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:10.834217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2fbbab79-727c-462d-b973-f788becbece5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:10.834970 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2fbbab79-727c-462d-b973-f788becbece5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:10.835430 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2fbbab79-727c-462d-b973-f788becbece5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:10.993363 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2fbbab79-727c-462d-b973-f788becbece5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:10.998275 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2fbbab79-727c-462d-b973-f788becbece5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.175431 Jun 29 11:29:10.999101 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 232/474] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:10 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:11.098332 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-f134b4dc-2776-4b2a-9166-d6c90c3f40f9 req-bd319956-a3e3-4a44-bf06-7022d642e1da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d99b83-36d5-48e9-9557-95e6f29f9f7e", "name": "network-vif-plugged", "status": "completed", "tag": "839607fb-10e5-4eaf-a58d-d39ced8e7b5a"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:29:11.107572 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f134b4dc-2776-4b2a-9166-d6c90c3f40f9 req-bd319956-a3e3-4a44-bf06-7022d642e1da service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:11.108122 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f134b4dc-2776-4b2a-9166-d6c90c3f40f9 req-bd319956-a3e3-4a44-bf06-7022d642e1da service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:11.119656 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-f134b4dc-2776-4b2a-9166-d6c90c3f40f9 req-bd319956-a3e3-4a44-bf06-7022d642e1da service nova] Creating event network-vif-plugged:839607fb-10e5-4eaf-a58d-d39ced8e7b5a for instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e on hv-cinder-84733 Jun 29 11:29:11.124819 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-f134b4dc-2776-4b2a-9166-d6c90c3f40f9 req-bd319956-a3e3-4a44-bf06-7022d642e1da service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030854 Jun 29 11:29:11.125580 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 243/475] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:29:11.605963 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-191daaf9-5d49-4b88-8656-ec05b59fdb97 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:11.606582 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-191daaf9-5d49-4b88-8656-ec05b59fdb97 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:11.613304 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-191daaf9-5d49-4b88-8656-ec05b59fdb97 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:11.613754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-191daaf9-5d49-4b88-8656-ec05b59fdb97 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:11.614621 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-191daaf9-5d49-4b88-8656-ec05b59fdb97 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:11.615064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-191daaf9-5d49-4b88-8656-ec05b59fdb97 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:11.750194 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-191daaf9-5d49-4b88-8656-ec05b59fdb97 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:11.757861 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-191daaf9-5d49-4b88-8656-ec05b59fdb97 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.156605 Jun 29 11:29:11.758417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 233/476] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:11 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:12.017512 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3c981f1d-db82-441e-8c5c-f6fdd86b329e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:12.018129 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3c981f1d-db82-441e-8c5c-f6fdd86b329e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:12.024812 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c981f1d-db82-441e-8c5c-f6fdd86b329e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:12.025253 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c981f1d-db82-441e-8c5c-f6fdd86b329e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:12.025993 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c981f1d-db82-441e-8c5c-f6fdd86b329e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:12.026422 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c981f1d-db82-441e-8c5c-f6fdd86b329e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:12.155613 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3c981f1d-db82-441e-8c5c-f6fdd86b329e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:12.163366 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3c981f1d-db82-441e-8c5c-f6fdd86b329e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.150620 Jun 29 11:29:12.163943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 244/477] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:12 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:12.774889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b2b9dd36-1315-4fc5-b893-c26731efd422 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:12.775489 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b2b9dd36-1315-4fc5-b893-c26731efd422 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:12.782007 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2b9dd36-1315-4fc5-b893-c26731efd422 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:12.782443 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2b9dd36-1315-4fc5-b893-c26731efd422 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:12.783188 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2b9dd36-1315-4fc5-b893-c26731efd422 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:12.783612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2b9dd36-1315-4fc5-b893-c26731efd422 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:12.909577 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b2b9dd36-1315-4fc5-b893-c26731efd422 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:12.917670 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b2b9dd36-1315-4fc5-b893-c26731efd422 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.146616 Jun 29 11:29:12.918238 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 234/478] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:12 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:13.180432 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-38c78366-9b89-452e-860d-dae6b1913681 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:13.180950 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-38c78366-9b89-452e-860d-dae6b1913681 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:13.182875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:29:13.188049 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38c78366-9b89-452e-860d-dae6b1913681 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:13.188494 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38c78366-9b89-452e-860d-dae6b1913681 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:13.189239 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38c78366-9b89-452e-860d-dae6b1913681 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:13.189661 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38c78366-9b89-452e-860d-dae6b1913681 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:13.323453 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38c78366-9b89-452e-860d-dae6b1913681 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:13.331626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-38c78366-9b89-452e-860d-dae6b1913681 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.155128 Jun 29 11:29:13.332222 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 245/479] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:13 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:13.934196 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-790e6455-dc44-4c90-af6d-759a511fb9e0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:13.934796 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-790e6455-dc44-4c90-af6d-759a511fb9e0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:13.941662 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-790e6455-dc44-4c90-af6d-759a511fb9e0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:13.942101 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-790e6455-dc44-4c90-af6d-759a511fb9e0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:13.942886 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-790e6455-dc44-4c90-af6d-759a511fb9e0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:13.943312 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-790e6455-dc44-4c90-af6d-759a511fb9e0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:14.071050 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-790e6455-dc44-4c90-af6d-759a511fb9e0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:14.078639 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-790e6455-dc44-4c90-af6d-759a511fb9e0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1266 microversion: 2.1 time: 0.148315 Jun 29 11:29:14.079196 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 235/480] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:13 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:14.349552 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4ad6f03f-304d-4f66-95a3-52c7cbbacf51 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:14.350077 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4ad6f03f-304d-4f66-95a3-52c7cbbacf51 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:14.356429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ad6f03f-304d-4f66-95a3-52c7cbbacf51 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:14.356869 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ad6f03f-304d-4f66-95a3-52c7cbbacf51 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:14.357610 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ad6f03f-304d-4f66-95a3-52c7cbbacf51 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:14.358042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ad6f03f-304d-4f66-95a3-52c7cbbacf51 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:14.495245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4ad6f03f-304d-4f66-95a3-52c7cbbacf51 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:14.497811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4ad6f03f-304d-4f66-95a3-52c7cbbacf51 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.152529 Jun 29 11:29:14.498373 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 246/481] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:14 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:15.095556 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3dbc68e6-4eec-421e-bb4a-bd3e32f58b43 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:15.096111 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3dbc68e6-4eec-421e-bb4a-bd3e32f58b43 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:15.103313 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3dbc68e6-4eec-421e-bb4a-bd3e32f58b43 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:15.103756 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3dbc68e6-4eec-421e-bb4a-bd3e32f58b43 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:15.104564 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3dbc68e6-4eec-421e-bb4a-bd3e32f58b43 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:15.104993 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3dbc68e6-4eec-421e-bb4a-bd3e32f58b43 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:15.232549 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3dbc68e6-4eec-421e-bb4a-bd3e32f58b43 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:15.240851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3dbc68e6-4eec-421e-bb4a-bd3e32f58b43 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1453 microversion: 2.1 time: 0.148850 Jun 29 11:29:15.242541 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 236/482] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:15 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:15.258333 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-703cc565-edc8-48f9-acc4-d5027444f7a6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:15.258941 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-703cc565-edc8-48f9-acc4-d5027444f7a6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:15.264850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-703cc565-edc8-48f9-acc4-d5027444f7a6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:15.265294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-703cc565-edc8-48f9-acc4-d5027444f7a6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:15.266045 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-703cc565-edc8-48f9-acc4-d5027444f7a6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:15.266482 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-703cc565-edc8-48f9-acc4-d5027444f7a6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:15.395517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-703cc565-edc8-48f9-acc4-d5027444f7a6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:15.403505 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-703cc565-edc8-48f9-acc4-d5027444f7a6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1453 microversion: 2.1 time: 0.149018 Jun 29 11:29:15.404163 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 247/483] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:15 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:15.514475 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-aec8da53-f024-4daf-b0bc-bb81cd80f994 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:15.515085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-aec8da53-f024-4daf-b0bc-bb81cd80f994 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:15.521359 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aec8da53-f024-4daf-b0bc-bb81cd80f994 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:15.521801 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aec8da53-f024-4daf-b0bc-bb81cd80f994 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:15.522838 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aec8da53-f024-4daf-b0bc-bb81cd80f994 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:15.524022 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aec8da53-f024-4daf-b0bc-bb81cd80f994 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:15.698120 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-aec8da53-f024-4daf-b0bc-bb81cd80f994 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:15.706216 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-aec8da53-f024-4daf-b0bc-bb81cd80f994 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.195578 Jun 29 11:29:15.708620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 237/484] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:15 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:16.724630 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1da6aa8-16ae-495b-a4ff-597a5aaa303a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:16.725838 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c1da6aa8-16ae-495b-a4ff-597a5aaa303a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:16.736025 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1da6aa8-16ae-495b-a4ff-597a5aaa303a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:16.736475 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1da6aa8-16ae-495b-a4ff-597a5aaa303a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:16.737246 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1da6aa8-16ae-495b-a4ff-597a5aaa303a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:16.737676 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1da6aa8-16ae-495b-a4ff-597a5aaa303a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:16.876344 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1da6aa8-16ae-495b-a4ff-597a5aaa303a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:16.880173 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c1da6aa8-16ae-495b-a4ff-597a5aaa303a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.160411 Jun 29 11:29:16.880743 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 248/485] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:16 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:17.625792 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-852dac76-6e77-4fa8-8af6-10c6b502c5d4 req-75969877-3002-49bf-981c-b38ba400c97e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d99b83-36d5-48e9-9557-95e6f29f9f7e", "tag": "839607fb-10e5-4eaf-a58d-d39ced8e7b5a"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:29:17.637039 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-852dac76-6e77-4fa8-8af6-10c6b502c5d4 req-75969877-3002-49bf-981c-b38ba400c97e service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:17.637777 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-852dac76-6e77-4fa8-8af6-10c6b502c5d4 req-75969877-3002-49bf-981c-b38ba400c97e service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:17.662246 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-852dac76-6e77-4fa8-8af6-10c6b502c5d4 req-75969877-3002-49bf-981c-b38ba400c97e service nova] Creating event network-changed:839607fb-10e5-4eaf-a58d-d39ced8e7b5a for instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e on hv-cinder-84733 Jun 29 11:29:17.670361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-852dac76-6e77-4fa8-8af6-10c6b502c5d4 req-75969877-3002-49bf-981c-b38ba400c97e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047651 Jun 29 11:29:17.673173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 238/486] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:29:17.773750 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d784e2ef-4fbb-47db-9757-f4bad4be52bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:17.775006 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d784e2ef-4fbb-47db-9757-f4bad4be52bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:17.782478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d784e2ef-4fbb-47db-9757-f4bad4be52bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:17.783150 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d784e2ef-4fbb-47db-9757-f4bad4be52bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:17.784092 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d784e2ef-4fbb-47db-9757-f4bad4be52bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:17.784685 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d784e2ef-4fbb-47db-9757-f4bad4be52bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:17.898740 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d3e574f3-38d2-4d6c-ad9d-00957d6dee3a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:17.899478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d3e574f3-38d2-4d6c-ad9d-00957d6dee3a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:17.907036 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3e574f3-38d2-4d6c-ad9d-00957d6dee3a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:17.907485 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3e574f3-38d2-4d6c-ad9d-00957d6dee3a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:17.908286 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3e574f3-38d2-4d6c-ad9d-00957d6dee3a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:17.908719 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d3e574f3-38d2-4d6c-ad9d-00957d6dee3a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:18.047950 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d784e2ef-4fbb-47db-9757-f4bad4be52bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:18.057353 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d784e2ef-4fbb-47db-9757-f4bad4be52bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1592 microversion: 2.1 time: 0.287484 Jun 29 11:29:18.068757 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 249/487] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:17 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1592 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:18.149941 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d3e574f3-38d2-4d6c-ad9d-00957d6dee3a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:18.159820 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d3e574f3-38d2-4d6c-ad9d-00957d6dee3a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1722 microversion: 2.1 time: 0.265942 Jun 29 11:29:18.170499 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 239/488] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:17 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:19.177851 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-253fc9cb-a00c-4334-be3b-077879502ffd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:19.178376 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-253fc9cb-a00c-4334-be3b-077879502ffd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:19.184848 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-253fc9cb-a00c-4334-be3b-077879502ffd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:19.185296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-253fc9cb-a00c-4334-be3b-077879502ffd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:19.186048 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-253fc9cb-a00c-4334-be3b-077879502ffd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:19.186477 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-253fc9cb-a00c-4334-be3b-077879502ffd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:19.324603 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-253fc9cb-a00c-4334-be3b-077879502ffd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:19.332853 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-253fc9cb-a00c-4334-be3b-077879502ffd tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1699 microversion: 2.1 time: 0.158815 Jun 29 11:29:19.333446 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 250/489] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:19 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:19.350441 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-27f46a6d-8c0c-4fd1-a7ee-a55e2d9ecf4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:29:19.357942 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27f46a6d-8c0c-4fd1-a7ee-a55e2d9ecf4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:19.358386 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27f46a6d-8c0c-4fd1-a7ee-a55e2d9ecf4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:19.422863 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-27f46a6d-8c0c-4fd1-a7ee-a55e2d9ecf4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Going to try to start instance {{(pid=117921) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 29 11:29:19.427630 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:29:19.676339 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-27f46a6d-8c0c-4fd1-a7ee-a55e2d9ecf4b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "POST /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/action" status: 202 len: 0 microversion: 2.1 time: 0.329969 Jun 29 11:29:19.676939 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 240/490] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:29:19 2022] POST /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 11:29:19.685302 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7410c22e-f0a1-43cb-a830-69ead323f843 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:19.686107 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7410c22e-f0a1-43cb-a830-69ead323f843 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:19.693286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7410c22e-f0a1-43cb-a830-69ead323f843 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:19.693725 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7410c22e-f0a1-43cb-a830-69ead323f843 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:19.694483 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7410c22e-f0a1-43cb-a830-69ead323f843 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:19.695488 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7410c22e-f0a1-43cb-a830-69ead323f843 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:19.827066 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7410c22e-f0a1-43cb-a830-69ead323f843 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:19.835241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7410c22e-f0a1-43cb-a830-69ead323f843 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1708 microversion: 2.1 time: 0.153672 Jun 29 11:29:19.840294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 251/491] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:19 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1708 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:20.356728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-f0a97806-cfc5-4e99-b89f-e5cdd7a18558 req-ba957fb1-5685-4ad2-99fd-57457d37a94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514fe8ac-ed28-4fb6-8f17-c9e43d34e032", "tag": "fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:29:20.366168 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f0a97806-cfc5-4e99-b89f-e5cdd7a18558 req-ba957fb1-5685-4ad2-99fd-57457d37a94c service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:20.366958 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f0a97806-cfc5-4e99-b89f-e5cdd7a18558 req-ba957fb1-5685-4ad2-99fd-57457d37a94c service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:20.379237 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-f0a97806-cfc5-4e99-b89f-e5cdd7a18558 req-ba957fb1-5685-4ad2-99fd-57457d37a94c service nova] Creating event network-changed:fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3 for instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 on hv-cinder-84733 Jun 29 11:29:20.384193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-f0a97806-cfc5-4e99-b89f-e5cdd7a18558 req-ba957fb1-5685-4ad2-99fd-57457d37a94c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031782 Jun 29 11:29:20.384798 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 241/492] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:29:20.853195 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aec64725-1d69-4021-a4e7-eb82d2646cae tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:20.856591 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aec64725-1d69-4021-a4e7-eb82d2646cae tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:20.865032 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aec64725-1d69-4021-a4e7-eb82d2646cae tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:20.865483 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aec64725-1d69-4021-a4e7-eb82d2646cae tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:20.866636 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aec64725-1d69-4021-a4e7-eb82d2646cae tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:20.867077 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aec64725-1d69-4021-a4e7-eb82d2646cae tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:21.110370 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aec64725-1d69-4021-a4e7-eb82d2646cae tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:21.119274 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aec64725-1d69-4021-a4e7-eb82d2646cae tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1708 microversion: 2.1 time: 0.270470 Jun 29 11:29:21.130278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 252/493] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:20 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1708 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:22.139627 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7f6bc376-9eeb-4805-9728-dbd9155d6a92 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:22.140434 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7f6bc376-9eeb-4805-9728-dbd9155d6a92 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:22.142431 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=64 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:29:22.147738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f6bc376-9eeb-4805-9728-dbd9155d6a92 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:22.148788 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f6bc376-9eeb-4805-9728-dbd9155d6a92 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:22.149650 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f6bc376-9eeb-4805-9728-dbd9155d6a92 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:22.150156 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f6bc376-9eeb-4805-9728-dbd9155d6a92 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:22.299778 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7f6bc376-9eeb-4805-9728-dbd9155d6a92 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:22.308337 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7f6bc376-9eeb-4805-9728-dbd9155d6a92 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1712 microversion: 2.1 time: 0.173833 Jun 29 11:29:22.308899 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 242/494] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:22 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1712 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:23.004447 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-801b51b0-d594-491d-8189-719f826a332f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1958344252"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:29:23.005010 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-801b51b0-d594-491d-8189-719f826a332f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:23.011742 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-801b51b0-d594-491d-8189-719f826a332f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:23.012217 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-801b51b0-d594-491d-8189-719f826a332f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:23.012998 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-801b51b0-d594-491d-8189-719f826a332f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:23.013428 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-801b51b0-d594-491d-8189-719f826a332f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:23.136923 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.network.security_group_api [None req-801b51b0-d594-491d-8189-719f826a332f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Adding security group 9342cc18-e8ad-4efd-8e77-676225b16d5a to port fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3 Jun 29 11:29:23.574293 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-801b51b0-d594-491d-8189-719f826a332f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "POST /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/action" status: 202 len: 0 microversion: 2.1 time: 0.574205 Jun 29 11:29:23.577895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 253/495] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:29:22 2022] POST /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:29:23.589196 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-01ad0980-121b-4dd1-b91b-5e29e4a53256 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:29:23.590174 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-01ad0980-121b-4dd1-b91b-5e29e4a53256 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:23.594258 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-0940c917-ac90-4ae9-8729-25ed90276477 req-dc5f33af-dd5d-46f6-9c09-4b847cf5cdec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514fe8ac-ed28-4fb6-8f17-c9e43d34e032", "tag": "fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:29:23.604478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01ad0980-121b-4dd1-b91b-5e29e4a53256 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:23.606074 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01ad0980-121b-4dd1-b91b-5e29e4a53256 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:23.607780 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01ad0980-121b-4dd1-b91b-5e29e4a53256 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:23.608746 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01ad0980-121b-4dd1-b91b-5e29e4a53256 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:23.615346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0940c917-ac90-4ae9-8729-25ed90276477 req-dc5f33af-dd5d-46f6-9c09-4b847cf5cdec service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:23.618785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0940c917-ac90-4ae9-8729-25ed90276477 req-dc5f33af-dd5d-46f6-9c09-4b847cf5cdec service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:23.623515 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:29:23.642406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-0940c917-ac90-4ae9-8729-25ed90276477 req-dc5f33af-dd5d-46f6-9c09-4b847cf5cdec service nova] Creating event network-changed:fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3 for instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 on hv-cinder-84733 Jun 29 11:29:23.649782 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-0940c917-ac90-4ae9-8729-25ed90276477 req-dc5f33af-dd5d-46f6-9c09-4b847cf5cdec service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065517 Jun 29 11:29:23.651701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 254/496] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:29:24.067679 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-01ad0980-121b-4dd1-b91b-5e29e4a53256 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:29:24.076366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-01ad0980-121b-4dd1-b91b-5e29e4a53256 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1757 microversion: 2.1 time: 0.496157 Jun 29 11:29:24.077174 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 243/497] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:29:23 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1757 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:29:55.019360 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=63 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:29:55.183541 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-efa9d2ef-7719-4610-956f-cf73f60b49fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f455d98c-7cb1-4e91-b14c-aa41db2bdbac"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:29:55.184765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-efa9d2ef-7719-4610-956f-cf73f60b49fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:29:55.190813 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efa9d2ef-7719-4610-956f-cf73f60b49fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:55.191263 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efa9d2ef-7719-4610-956f-cf73f60b49fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:55.192052 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efa9d2ef-7719-4610-956f-cf73f60b49fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:29:55.192494 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-efa9d2ef-7719-4610-956f-cf73f60b49fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:29:55.957950 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-efa9d2ef-7719-4610-956f-cf73f60b49fc tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "POST /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.940058 Jun 29 11:29:55.958558 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 255/498] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:29:55 2022] POST /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments => generated 194 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:30:01.481610 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8788687c-1680-4285-8ccc-c8dffcb39faf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:01.482163 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8788687c-1680-4285-8ccc-c8dffcb39faf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:01.484047 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:30:01.484953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:30:01.490162 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8788687c-1680-4285-8ccc-c8dffcb39faf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:01.490600 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8788687c-1680-4285-8ccc-c8dffcb39faf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:01.491360 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8788687c-1680-4285-8ccc-c8dffcb39faf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:01.492333 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8788687c-1680-4285-8ccc-c8dffcb39faf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:01.515242 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8788687c-1680-4285-8ccc-c8dffcb39faf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/ips" status: 200 len: 152 microversion: 2.20 time: 0.037848 Jun 29 11:30:01.515796 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 244/499] 10.222.0.44 () {60 vars in 1288 bytes} [Wed Jun 29 11:30:01 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:30:04.497270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3821d940-7788-4541-99be-be4869eead4b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:30:04.498364 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3821d940-7788-4541-99be-be4869eead4b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:04.504414 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3821d940-7788-4541-99be-be4869eead4b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:04.504857 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3821d940-7788-4541-99be-be4869eead4b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:04.505601 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3821d940-7788-4541-99be-be4869eead4b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:04.506029 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3821d940-7788-4541-99be-be4869eead4b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:04.528576 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-3821d940-7788-4541-99be-be4869eead4b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lazy-loading 'flavor' on Instance uuid 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:30:04.767737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d18b58e4-b353-4e54-8cee-6da0264210bc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:30:04.768369 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d18b58e4-b353-4e54-8cee-6da0264210bc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:04.776089 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d18b58e4-b353-4e54-8cee-6da0264210bc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:04.776647 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d18b58e4-b353-4e54-8cee-6da0264210bc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:04.777410 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d18b58e4-b353-4e54-8cee-6da0264210bc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:04.777845 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d18b58e4-b353-4e54-8cee-6da0264210bc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:04.799596 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-d18b58e4-b353-4e54-8cee-6da0264210bc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lazy-loading 'flavor' on Instance uuid bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:30:04.814487 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3821d940-7788-4541-99be-be4869eead4b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "POST /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/action" status: 200 len: 32 microversion: 2.1 time: 0.321403 Jun 29 11:30:04.815089 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 256/500] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:30:04 2022] POST /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/action => generated 32 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 11:30:04.824433 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2ace7ee-bde8-4752-a09f-c07f99e6fed1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:04.825126 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b2ace7ee-bde8-4752-a09f-c07f99e6fed1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:04.831875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2ace7ee-bde8-4752-a09f-c07f99e6fed1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:04.832412 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2ace7ee-bde8-4752-a09f-c07f99e6fed1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:04.833175 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2ace7ee-bde8-4752-a09f-c07f99e6fed1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:04.833608 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2ace7ee-bde8-4752-a09f-c07f99e6fed1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:04.965617 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b2ace7ee-bde8-4752-a09f-c07f99e6fed1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:04.974816 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b2ace7ee-bde8-4752-a09f-c07f99e6fed1 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.154295 Jun 29 11:30:04.975396 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 257/501] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:04 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:30:05.429306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d18b58e4-b353-4e54-8cee-6da0264210bc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "POST /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/action" status: 202 len: 0 microversion: 2.20 time: 0.665950 Jun 29 11:30:05.430209 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 245/502] 10.222.0.44 () {62 vars in 1318 bytes} [Wed Jun 29 11:30:04 2022] POST /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 29 11:30:05.438811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-914254cd-9242-4b54-914f-6aa87a09d95c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:05.439790 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-914254cd-9242-4b54-914f-6aa87a09d95c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:05.446571 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-914254cd-9242-4b54-914f-6aa87a09d95c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:05.447011 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-914254cd-9242-4b54-914f-6aa87a09d95c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:05.447888 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-914254cd-9242-4b54-914f-6aa87a09d95c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:05.448324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-914254cd-9242-4b54-914f-6aa87a09d95c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:05.580972 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-914254cd-9242-4b54-914f-6aa87a09d95c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:05.588889 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-914254cd-9242-4b54-914f-6aa87a09d95c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:05.590474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-914254cd-9242-4b54-914f-6aa87a09d95c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:05.591641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-914254cd-9242-4b54-914f-6aa87a09d95c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.156940 Jun 29 11:30:05.592220 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 258/503] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:05 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:30:05.992449 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-40763b32-182b-4d71-b93f-76a68146a5a7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:05.993149 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-40763b32-182b-4d71-b93f-76a68146a5a7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:05.999364 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40763b32-182b-4d71-b93f-76a68146a5a7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:05.999808 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40763b32-182b-4d71-b93f-76a68146a5a7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:06.000590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40763b32-182b-4d71-b93f-76a68146a5a7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:06.001023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40763b32-182b-4d71-b93f-76a68146a5a7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:06.131418 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-40763b32-182b-4d71-b93f-76a68146a5a7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:06.139241 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-40763b32-182b-4d71-b93f-76a68146a5a7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.151421 Jun 29 11:30:06.139738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 246/504] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:05 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:06.611001 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3d9f58a-ffa5-4fef-b4c6-7118ffd37376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:06.611610 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3d9f58a-ffa5-4fef-b4c6-7118ffd37376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:06.618074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d9f58a-ffa5-4fef-b4c6-7118ffd37376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:06.618521 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d9f58a-ffa5-4fef-b4c6-7118ffd37376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:06.619273 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d9f58a-ffa5-4fef-b4c6-7118ffd37376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:06.619712 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3d9f58a-ffa5-4fef-b4c6-7118ffd37376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:06.745965 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3d9f58a-ffa5-4fef-b4c6-7118ffd37376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:06.754366 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3d9f58a-ffa5-4fef-b4c6-7118ffd37376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:06.755902 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3d9f58a-ffa5-4fef-b4c6-7118ffd37376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:06.757070 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3d9f58a-ffa5-4fef-b4c6-7118ffd37376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.150532 Jun 29 11:30:06.757625 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 259/505] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:06 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:07.156902 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4953f188-fa46-45ff-be37-6423d21e9bb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:07.157965 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4953f188-fa46-45ff-be37-6423d21e9bb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:07.164525 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4953f188-fa46-45ff-be37-6423d21e9bb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:07.164968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4953f188-fa46-45ff-be37-6423d21e9bb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:07.165709 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4953f188-fa46-45ff-be37-6423d21e9bb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:07.166141 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4953f188-fa46-45ff-be37-6423d21e9bb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:07.295100 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4953f188-fa46-45ff-be37-6423d21e9bb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:07.303319 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4953f188-fa46-45ff-be37-6423d21e9bb8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.150395 Jun 29 11:30:07.303919 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 247/506] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:07 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:07.776430 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c4be08b9-b042-4efc-a294-6ea807424d79 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:07.776993 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c4be08b9-b042-4efc-a294-6ea807424d79 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:07.783525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4be08b9-b042-4efc-a294-6ea807424d79 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:07.784027 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4be08b9-b042-4efc-a294-6ea807424d79 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:07.784799 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4be08b9-b042-4efc-a294-6ea807424d79 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:07.785235 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4be08b9-b042-4efc-a294-6ea807424d79 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:07.917870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c4be08b9-b042-4efc-a294-6ea807424d79 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:07.926345 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c4be08b9-b042-4efc-a294-6ea807424d79 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:07.928125 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c4be08b9-b042-4efc-a294-6ea807424d79 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:07.929278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c4be08b9-b042-4efc-a294-6ea807424d79 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.156858 Jun 29 11:30:07.929829 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 260/507] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:07 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:08.320897 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3e050733-051d-417e-9672-b5ca5c0fdb89 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:08.321506 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3e050733-051d-417e-9672-b5ca5c0fdb89 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:08.327905 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e050733-051d-417e-9672-b5ca5c0fdb89 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:08.328347 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e050733-051d-417e-9672-b5ca5c0fdb89 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:08.329093 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e050733-051d-417e-9672-b5ca5c0fdb89 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:08.329520 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e050733-051d-417e-9672-b5ca5c0fdb89 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:08.454562 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3e050733-051d-417e-9672-b5ca5c0fdb89 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:08.462408 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3e050733-051d-417e-9672-b5ca5c0fdb89 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.145489 Jun 29 11:30:08.462961 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 248/508] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:08 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:08.947729 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-68474e7c-ebfc-4263-960b-327788f545c6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:08.948396 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-68474e7c-ebfc-4263-960b-327788f545c6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:08.955261 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68474e7c-ebfc-4263-960b-327788f545c6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:08.955699 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68474e7c-ebfc-4263-960b-327788f545c6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:08.956472 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68474e7c-ebfc-4263-960b-327788f545c6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:08.956910 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68474e7c-ebfc-4263-960b-327788f545c6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:09.084878 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-68474e7c-ebfc-4263-960b-327788f545c6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:09.092605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-68474e7c-ebfc-4263-960b-327788f545c6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:09.094092 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-68474e7c-ebfc-4263-960b-327788f545c6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:09.095849 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-68474e7c-ebfc-4263-960b-327788f545c6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.151382 Jun 29 11:30:09.096407 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 261/509] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:08 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:09.480259 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9e3e4f9f-bdc3-4fd6-8c3e-a6027d34d9b4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:09.480861 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9e3e4f9f-bdc3-4fd6-8c3e-a6027d34d9b4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:09.488052 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e3e4f9f-bdc3-4fd6-8c3e-a6027d34d9b4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:09.488491 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e3e4f9f-bdc3-4fd6-8c3e-a6027d34d9b4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:09.489242 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e3e4f9f-bdc3-4fd6-8c3e-a6027d34d9b4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:09.489665 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e3e4f9f-bdc3-4fd6-8c3e-a6027d34d9b4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:09.631280 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9e3e4f9f-bdc3-4fd6-8c3e-a6027d34d9b4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:09.639253 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9e3e4f9f-bdc3-4fd6-8c3e-a6027d34d9b4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.163025 Jun 29 11:30:09.639815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 249/510] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:09 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:30:10.114101 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-165cae33-4bbb-40fc-8198-9cd1411476d9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:10.114698 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-165cae33-4bbb-40fc-8198-9cd1411476d9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:10.121011 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-165cae33-4bbb-40fc-8198-9cd1411476d9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:10.121449 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-165cae33-4bbb-40fc-8198-9cd1411476d9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:10.122193 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-165cae33-4bbb-40fc-8198-9cd1411476d9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:10.122617 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-165cae33-4bbb-40fc-8198-9cd1411476d9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:10.253195 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-165cae33-4bbb-40fc-8198-9cd1411476d9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:10.261083 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-165cae33-4bbb-40fc-8198-9cd1411476d9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:10.262607 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-165cae33-4bbb-40fc-8198-9cd1411476d9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:10.263762 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-165cae33-4bbb-40fc-8198-9cd1411476d9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.153580 Jun 29 11:30:10.264341 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 262/511] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:10 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:10.656339 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b4f99639-1771-4636-8652-9ee028677b7b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:10.656867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b4f99639-1771-4636-8652-9ee028677b7b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:10.663721 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4f99639-1771-4636-8652-9ee028677b7b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:10.664196 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4f99639-1771-4636-8652-9ee028677b7b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:10.664950 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4f99639-1771-4636-8652-9ee028677b7b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:10.665406 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4f99639-1771-4636-8652-9ee028677b7b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:10.793543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b4f99639-1771-4636-8652-9ee028677b7b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:10.802063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b4f99639-1771-4636-8652-9ee028677b7b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.149680 Jun 29 11:30:10.802621 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 250/512] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:10 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:11.281804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dc964041-12a4-488c-98e8-c10d90bd4623 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:11.283029 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dc964041-12a4-488c-98e8-c10d90bd4623 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:11.289365 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc964041-12a4-488c-98e8-c10d90bd4623 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:11.289803 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc964041-12a4-488c-98e8-c10d90bd4623 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:11.290545 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc964041-12a4-488c-98e8-c10d90bd4623 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:11.290970 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc964041-12a4-488c-98e8-c10d90bd4623 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:11.425148 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dc964041-12a4-488c-98e8-c10d90bd4623 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:11.433053 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dc964041-12a4-488c-98e8-c10d90bd4623 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:11.434551 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dc964041-12a4-488c-98e8-c10d90bd4623 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:11.435695 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dc964041-12a4-488c-98e8-c10d90bd4623 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.157736 Jun 29 11:30:11.436832 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 263/513] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:11 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:11.817945 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b6da5c09-f610-4ad5-9838-d15df4070423 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:11.818564 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b6da5c09-f610-4ad5-9838-d15df4070423 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:11.825056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6da5c09-f610-4ad5-9838-d15df4070423 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:11.825497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6da5c09-f610-4ad5-9838-d15df4070423 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:11.826242 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6da5c09-f610-4ad5-9838-d15df4070423 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:11.826670 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b6da5c09-f610-4ad5-9838-d15df4070423 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:11.955429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b6da5c09-f610-4ad5-9838-d15df4070423 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:11.963342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b6da5c09-f610-4ad5-9838-d15df4070423 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.149162 Jun 29 11:30:11.963925 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 251/514] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:11 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:12.455088 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c651094f-99a5-4290-a27c-c750aa8fc0e0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:12.455749 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c651094f-99a5-4290-a27c-c750aa8fc0e0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:12.462213 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c651094f-99a5-4290-a27c-c750aa8fc0e0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:12.462661 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c651094f-99a5-4290-a27c-c750aa8fc0e0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:12.463414 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c651094f-99a5-4290-a27c-c750aa8fc0e0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:12.463876 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c651094f-99a5-4290-a27c-c750aa8fc0e0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:12.594722 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c651094f-99a5-4290-a27c-c750aa8fc0e0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:12.602741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c651094f-99a5-4290-a27c-c750aa8fc0e0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:12.604265 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c651094f-99a5-4290-a27c-c750aa8fc0e0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:12.605404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c651094f-99a5-4290-a27c-c750aa8fc0e0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.154847 Jun 29 11:30:12.605957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 264/515] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:12 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:12.981103 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-95fb34e5-5dba-429d-bf09-f7b250692046 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:12.981715 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-95fb34e5-5dba-429d-bf09-f7b250692046 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:12.988822 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95fb34e5-5dba-429d-bf09-f7b250692046 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:12.989268 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95fb34e5-5dba-429d-bf09-f7b250692046 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:12.990025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95fb34e5-5dba-429d-bf09-f7b250692046 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:12.990458 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95fb34e5-5dba-429d-bf09-f7b250692046 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:13.121739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-95fb34e5-5dba-429d-bf09-f7b250692046 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:13.129887 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-95fb34e5-5dba-429d-bf09-f7b250692046 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.152741 Jun 29 11:30:13.130650 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 252/516] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:12 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:13.624241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-69e01fe6-d6cb-4e90-9988-58e0a09b6ff2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:13.624864 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-69e01fe6-d6cb-4e90-9988-58e0a09b6ff2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:13.631599 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69e01fe6-d6cb-4e90-9988-58e0a09b6ff2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:13.635287 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69e01fe6-d6cb-4e90-9988-58e0a09b6ff2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:13.635287 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69e01fe6-d6cb-4e90-9988-58e0a09b6ff2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:13.635287 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69e01fe6-d6cb-4e90-9988-58e0a09b6ff2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:13.762302 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-69e01fe6-d6cb-4e90-9988-58e0a09b6ff2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:13.770182 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-69e01fe6-d6cb-4e90-9988-58e0a09b6ff2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:13.771660 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-69e01fe6-d6cb-4e90-9988-58e0a09b6ff2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:13.772831 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-69e01fe6-d6cb-4e90-9988-58e0a09b6ff2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.152621 Jun 29 11:30:13.773396 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 265/517] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:13 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:14.147154 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-253f0643-b1a0-4dc9-aee7-b86fac5004b3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:14.147796 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-253f0643-b1a0-4dc9-aee7-b86fac5004b3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:14.154855 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-253f0643-b1a0-4dc9-aee7-b86fac5004b3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:14.155302 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-253f0643-b1a0-4dc9-aee7-b86fac5004b3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:14.156097 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-253f0643-b1a0-4dc9-aee7-b86fac5004b3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:14.156534 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-253f0643-b1a0-4dc9-aee7-b86fac5004b3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:14.293209 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-253f0643-b1a0-4dc9-aee7-b86fac5004b3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:14.301489 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-253f0643-b1a0-4dc9-aee7-b86fac5004b3 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.158388 Jun 29 11:30:14.302046 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 253/518] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:14 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:14.790478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-284f71a7-7e9b-485d-bf9c-f0bdd7a756cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:14.791089 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-284f71a7-7e9b-485d-bf9c-f0bdd7a756cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:14.797621 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-284f71a7-7e9b-485d-bf9c-f0bdd7a756cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:14.798050 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-284f71a7-7e9b-485d-bf9c-f0bdd7a756cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:14.798808 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-284f71a7-7e9b-485d-bf9c-f0bdd7a756cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:14.799240 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-284f71a7-7e9b-485d-bf9c-f0bdd7a756cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:14.940157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-284f71a7-7e9b-485d-bf9c-f0bdd7a756cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:14.944387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-284f71a7-7e9b-485d-bf9c-f0bdd7a756cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:14.945920 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-284f71a7-7e9b-485d-bf9c-f0bdd7a756cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:14.947060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-284f71a7-7e9b-485d-bf9c-f0bdd7a756cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.160532 Jun 29 11:30:14.947609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 266/519] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:14 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:15.318252 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d2a79810-486f-4103-bf0b-a21c84a928bf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:15.318882 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d2a79810-486f-4103-bf0b-a21c84a928bf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:15.325859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2a79810-486f-4103-bf0b-a21c84a928bf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:15.326311 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2a79810-486f-4103-bf0b-a21c84a928bf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:15.327072 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2a79810-486f-4103-bf0b-a21c84a928bf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:15.327507 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2a79810-486f-4103-bf0b-a21c84a928bf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:15.465474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d2a79810-486f-4103-bf0b-a21c84a928bf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:15.474516 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d2a79810-486f-4103-bf0b-a21c84a928bf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.160099 Jun 29 11:30:15.475078 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 254/520] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:15 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:15.965214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1239873e-f2d0-4b94-b5b1-41d2d33ac92b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:15.965820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1239873e-f2d0-4b94-b5b1-41d2d33ac92b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:15.972410 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1239873e-f2d0-4b94-b5b1-41d2d33ac92b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:15.972851 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1239873e-f2d0-4b94-b5b1-41d2d33ac92b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:15.973605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1239873e-f2d0-4b94-b5b1-41d2d33ac92b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:15.974293 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1239873e-f2d0-4b94-b5b1-41d2d33ac92b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:16.104015 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1239873e-f2d0-4b94-b5b1-41d2d33ac92b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:16.111640 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1239873e-f2d0-4b94-b5b1-41d2d33ac92b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:16.113158 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1239873e-f2d0-4b94-b5b1-41d2d33ac92b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:16.114283 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1239873e-f2d0-4b94-b5b1-41d2d33ac92b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.152894 Jun 29 11:30:16.114831 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 267/521] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:15 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:16.491459 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5ab38b8d-88fa-4466-9056-49faca899632 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:16.492155 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5ab38b8d-88fa-4466-9056-49faca899632 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:16.498631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ab38b8d-88fa-4466-9056-49faca899632 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:16.499076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ab38b8d-88fa-4466-9056-49faca899632 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:16.499843 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ab38b8d-88fa-4466-9056-49faca899632 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:16.500282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ab38b8d-88fa-4466-9056-49faca899632 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:16.627011 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5ab38b8d-88fa-4466-9056-49faca899632 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:16.634899 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5ab38b8d-88fa-4466-9056-49faca899632 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.147310 Jun 29 11:30:16.635459 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 255/522] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:16 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:17.132985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-60ff98b3-af96-4065-b44f-d44d4b48d44d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:17.133542 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-60ff98b3-af96-4065-b44f-d44d4b48d44d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:17.139958 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60ff98b3-af96-4065-b44f-d44d4b48d44d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:17.140404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60ff98b3-af96-4065-b44f-d44d4b48d44d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:17.141160 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60ff98b3-af96-4065-b44f-d44d4b48d44d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:17.141594 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-60ff98b3-af96-4065-b44f-d44d4b48d44d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:17.145520 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:30:17.279898 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-60ff98b3-af96-4065-b44f-d44d4b48d44d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:17.287632 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-60ff98b3-af96-4065-b44f-d44d4b48d44d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:17.289147 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-60ff98b3-af96-4065-b44f-d44d4b48d44d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:17.290273 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-60ff98b3-af96-4065-b44f-d44d4b48d44d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.161230 Jun 29 11:30:17.290820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 268/523] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:17 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:17.651509 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ca4b70e8-216f-4294-823f-1ff28cf165ef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:17.652152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ca4b70e8-216f-4294-823f-1ff28cf165ef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:17.659084 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ca4b70e8-216f-4294-823f-1ff28cf165ef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:17.659523 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ca4b70e8-216f-4294-823f-1ff28cf165ef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:17.660305 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ca4b70e8-216f-4294-823f-1ff28cf165ef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:17.660741 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ca4b70e8-216f-4294-823f-1ff28cf165ef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:17.786931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ca4b70e8-216f-4294-823f-1ff28cf165ef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:17.794770 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ca4b70e8-216f-4294-823f-1ff28cf165ef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.147212 Jun 29 11:30:17.795343 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 256/524] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:17 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:18.308897 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f122bba9-1150-4521-9915-4b8f38bb89cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:18.309514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f122bba9-1150-4521-9915-4b8f38bb89cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:18.315954 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f122bba9-1150-4521-9915-4b8f38bb89cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:18.316402 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f122bba9-1150-4521-9915-4b8f38bb89cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:18.317164 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f122bba9-1150-4521-9915-4b8f38bb89cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:18.317599 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f122bba9-1150-4521-9915-4b8f38bb89cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:18.449364 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f122bba9-1150-4521-9915-4b8f38bb89cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:18.457700 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f122bba9-1150-4521-9915-4b8f38bb89cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:18.459203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f122bba9-1150-4521-9915-4b8f38bb89cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:18.460369 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f122bba9-1150-4521-9915-4b8f38bb89cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.155358 Jun 29 11:30:18.460933 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 269/525] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:18 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:18.813121 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-205576e8-5803-4ed4-8d5d-6f63ff0aa72c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:18.815173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-205576e8-5803-4ed4-8d5d-6f63ff0aa72c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:18.823704 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-205576e8-5803-4ed4-8d5d-6f63ff0aa72c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:18.824365 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-205576e8-5803-4ed4-8d5d-6f63ff0aa72c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:18.825414 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-205576e8-5803-4ed4-8d5d-6f63ff0aa72c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:18.826000 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-205576e8-5803-4ed4-8d5d-6f63ff0aa72c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:19.066012 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-205576e8-5803-4ed4-8d5d-6f63ff0aa72c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:19.074048 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-205576e8-5803-4ed4-8d5d-6f63ff0aa72c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.266003 Jun 29 11:30:19.078348 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 257/526] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:18 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:19.478772 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-347fa9b9-b8ec-452c-91f2-2df8118e5823 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:19.479386 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-347fa9b9-b8ec-452c-91f2-2df8118e5823 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:19.486652 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-347fa9b9-b8ec-452c-91f2-2df8118e5823 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:19.486868 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-347fa9b9-b8ec-452c-91f2-2df8118e5823 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:19.487625 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-347fa9b9-b8ec-452c-91f2-2df8118e5823 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:19.488108 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-347fa9b9-b8ec-452c-91f2-2df8118e5823 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:19.618408 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-347fa9b9-b8ec-452c-91f2-2df8118e5823 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:19.626468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-347fa9b9-b8ec-452c-91f2-2df8118e5823 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:19.627999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-347fa9b9-b8ec-452c-91f2-2df8118e5823 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:19.629147 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-347fa9b9-b8ec-452c-91f2-2df8118e5823 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1745 microversion: 2.20 time: 0.154212 Jun 29 11:30:19.629701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 270/527] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:19 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:20.091231 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1880e989-cdd7-472f-96a5-53ab4060326e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:20.091847 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1880e989-cdd7-472f-96a5-53ab4060326e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:20.098504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1880e989-cdd7-472f-96a5-53ab4060326e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:20.099206 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1880e989-cdd7-472f-96a5-53ab4060326e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:20.099999 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1880e989-cdd7-472f-96a5-53ab4060326e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:20.100434 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1880e989-cdd7-472f-96a5-53ab4060326e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:20.227941 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1880e989-cdd7-472f-96a5-53ab4060326e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:20.231373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:30:20.236762 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1880e989-cdd7-472f-96a5-53ab4060326e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.149354 Jun 29 11:30:20.237342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 258/528] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:20 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:20.648122 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7530fd81-abc1-447a-a109-5974584e6363 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:20.648730 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7530fd81-abc1-447a-a109-5974584e6363 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:20.655068 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7530fd81-abc1-447a-a109-5974584e6363 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:20.655542 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7530fd81-abc1-447a-a109-5974584e6363 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:20.656326 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7530fd81-abc1-447a-a109-5974584e6363 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:20.656758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7530fd81-abc1-447a-a109-5974584e6363 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:20.796232 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7530fd81-abc1-447a-a109-5974584e6363 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:20.804483 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7530fd81-abc1-447a-a109-5974584e6363 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:20.807283 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7530fd81-abc1-447a-a109-5974584e6363 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:20.809520 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7530fd81-abc1-447a-a109-5974584e6363 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1745 microversion: 2.20 time: 0.165013 Jun 29 11:30:20.810202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 271/529] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:20 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:21.052152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-ec1ab8a6-c5e1-48fc-a8a0-8cb9dbfc3d9c req-628c35e3-34b5-4313-9232-f8d5d4507978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde34fdf-bfe6-48a4-9b9e-95ff879ffa70", "name": "network-vif-plugged", "status": "completed", "tag": "dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:30:21.067009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ec1ab8a6-c5e1-48fc-a8a0-8cb9dbfc3d9c req-628c35e3-34b5-4313-9232-f8d5d4507978 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:21.069346 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ec1ab8a6-c5e1-48fc-a8a0-8cb9dbfc3d9c req-628c35e3-34b5-4313-9232-f8d5d4507978 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:21.078665 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-ec1ab8a6-c5e1-48fc-a8a0-8cb9dbfc3d9c req-628c35e3-34b5-4313-9232-f8d5d4507978 service nova] Creating event network-vif-plugged:dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48 for instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 on hv-cinder-84733 Jun 29 11:30:21.084826 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-ec1ab8a6-c5e1-48fc-a8a0-8cb9dbfc3d9c req-628c35e3-34b5-4313-9232-f8d5d4507978 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098751 Jun 29 11:30:21.085843 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 259/530] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:30:21.254200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-19a883cb-d01c-441e-8d50-351ef181174f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:21.254804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-19a883cb-d01c-441e-8d50-351ef181174f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:21.260870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19a883cb-d01c-441e-8d50-351ef181174f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:21.261318 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19a883cb-d01c-441e-8d50-351ef181174f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:21.262082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19a883cb-d01c-441e-8d50-351ef181174f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:21.262513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19a883cb-d01c-441e-8d50-351ef181174f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:21.403172 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-19a883cb-d01c-441e-8d50-351ef181174f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:21.415134 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-19a883cb-d01c-441e-8d50-351ef181174f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1736 microversion: 2.1 time: 0.165252 Jun 29 11:30:21.415725 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 272/531] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:21 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:21.828903 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cae17b5b-6020-4dec-a030-9524a24628b9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:21.829586 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cae17b5b-6020-4dec-a030-9524a24628b9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:21.835996 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cae17b5b-6020-4dec-a030-9524a24628b9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:21.836433 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cae17b5b-6020-4dec-a030-9524a24628b9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:21.837202 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cae17b5b-6020-4dec-a030-9524a24628b9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:21.837625 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cae17b5b-6020-4dec-a030-9524a24628b9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:21.967398 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cae17b5b-6020-4dec-a030-9524a24628b9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:21.976307 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cae17b5b-6020-4dec-a030-9524a24628b9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:21.977809 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cae17b5b-6020-4dec-a030-9524a24628b9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:21.979007 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cae17b5b-6020-4dec-a030-9524a24628b9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1745 microversion: 2.20 time: 0.154920 Jun 29 11:30:21.979554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 260/532] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:21 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:22.431698 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-51f900ea-6fb6-436b-98d0-d6e435b1ebf7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:22.432347 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-51f900ea-6fb6-436b-98d0-d6e435b1ebf7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:22.438998 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51f900ea-6fb6-436b-98d0-d6e435b1ebf7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:22.439448 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51f900ea-6fb6-436b-98d0-d6e435b1ebf7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:22.440243 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51f900ea-6fb6-436b-98d0-d6e435b1ebf7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:22.440679 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51f900ea-6fb6-436b-98d0-d6e435b1ebf7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:22.568678 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-51f900ea-6fb6-436b-98d0-d6e435b1ebf7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:22.576369 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-51f900ea-6fb6-436b-98d0-d6e435b1ebf7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1716 microversion: 2.1 time: 0.148545 Jun 29 11:30:22.581688 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 273/533] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:22 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:22.630110 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df60ad7f-fc09-4a91-90c4-f0ccab9d2e2d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:22.630604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-df60ad7f-fc09-4a91-90c4-f0ccab9d2e2d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:22.637077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df60ad7f-fc09-4a91-90c4-f0ccab9d2e2d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:22.637525 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df60ad7f-fc09-4a91-90c4-f0ccab9d2e2d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:22.638283 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df60ad7f-fc09-4a91-90c4-f0ccab9d2e2d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:22.638718 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df60ad7f-fc09-4a91-90c4-f0ccab9d2e2d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:22.761106 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-df60ad7f-fc09-4a91-90c4-f0ccab9d2e2d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] HTTP exception thrown: Cannot 'detach_volume' instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 while it is in vm_state rescued Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df60ad7f-fc09-4a91-90c4-f0ccab9d2e2d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Request method failure captured: Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments/f455d98c-7cb1-4e91-b14c-aa41db2bdbac HTTP/1.1 Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDZ_hdMYJgq85a0ANpS40L4DnIBMc0L0w2VQmyJptv9vz09vZSHBB5QFP-MIu6lCP_6R2lFejZ1fXBaWqeb2npwIbc3ySbmlrb6USsshKBJfEjko0jZsW2Xjk92OrwImioiZjr5m7Rnec6Fs2oG7eh3N0QRHWm0LQ2lzMoWq-s9mREA Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: cbfba915f70342afb8267e34abc24bfe Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:30:22.762714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:30:22.764193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cbfba915f70342afb8267e34abc24bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cbfba915f70342afb8267e34abc24bfe", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbfba915f70342afb8267e34abc24bfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbfba915f70342afb8267e34abc24bfe"}]}] Jun 29 11:30:22.764193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:30:22.764193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: cbfba915f70342afb8267e34abc24bfe Jun 29 11:30:22.764193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:30:22.764193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-ServerRescueNegativeTestJSON-21742587-project Jun 29 11:30:22.764193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:30:22.764193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:30:22.764193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 8effcd6f6be64f14b3c8bc71f8866a99 Jun 29 11:30:22.764193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-ServerRescueNegativeTestJSON-21742587-project Jun 29 11:30:22.764193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:30:22.764193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Cannot 'detach_volume' instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 while it is in vm_state rescued Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'server_id': '3d3fb170-5d34-4fa4-8baa-5e404f52f4f2', 'id': 'f455d98c-7cb1-4e91-b14c-aa41db2bdbac'} Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:30:22.765766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 while it is in vm_state rescued Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 while it is in vm_state rescued Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:30:22.768075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df60ad7f-fc09-4a91-90c4-f0ccab9d2e2d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Returning 409 to user: Cannot 'detach_volume' instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 while it is in vm_state rescued {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:30:22.769305 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-df60ad7f-fc09-4a91-90c4-f0ccab9d2e2d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments/f455d98c-7cb1-4e91-b14c-aa41db2bdbac" status: 409 len: 152 microversion: 2.1 time: 0.138646 Jun 29 11:30:22.769305 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 261/534] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jun 29 11:30:22 2022] DELETE /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments/f455d98c-7cb1-4e91-b14c-aa41db2bdbac => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 29 11:30:22.774493 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-728be1bc-78a5-4bbf-ae12-b43f25cc78df tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:30:22.775021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-728be1bc-78a5-4bbf-ae12-b43f25cc78df tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:22.780846 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-728be1bc-78a5-4bbf-ae12-b43f25cc78df tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:22.781283 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-728be1bc-78a5-4bbf-ae12-b43f25cc78df tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:22.782025 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-728be1bc-78a5-4bbf-ae12-b43f25cc78df tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:22.782447 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-728be1bc-78a5-4bbf-ae12-b43f25cc78df tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:22.940517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-728be1bc-78a5-4bbf-ae12-b43f25cc78df tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "POST /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/action" status: 202 len: 0 microversion: 2.1 time: 0.169617 Jun 29 11:30:22.941148 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 274/535] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:30:22 2022] POST /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:30:22.949210 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ead12be1-0e4c-42e6-8220-df2329c0536b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:22.954022 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ead12be1-0e4c-42e6-8220-df2329c0536b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:22.957258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ead12be1-0e4c-42e6-8220-df2329c0536b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:22.957705 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ead12be1-0e4c-42e6-8220-df2329c0536b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:22.958474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ead12be1-0e4c-42e6-8220-df2329c0536b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:22.958908 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ead12be1-0e4c-42e6-8220-df2329c0536b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:23.002362 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-602f46b4-7b20-4cbf-9ae9-f2819ab414c2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:23.002362 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-602f46b4-7b20-4cbf-9ae9-f2819ab414c2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:23.006183 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-602f46b4-7b20-4cbf-9ae9-f2819ab414c2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:23.006633 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-602f46b4-7b20-4cbf-9ae9-f2819ab414c2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:23.007409 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-602f46b4-7b20-4cbf-9ae9-f2819ab414c2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:23.007863 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-602f46b4-7b20-4cbf-9ae9-f2819ab414c2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:23.184157 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ead12be1-0e4c-42e6-8220-df2329c0536b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:23.193664 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ead12be1-0e4c-42e6-8220-df2329c0536b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1724 microversion: 2.1 time: 0.248216 Jun 29 11:30:23.194238 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 262/536] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:22 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:23.267584 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-602f46b4-7b20-4cbf-9ae9-f2819ab414c2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:23.275362 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-602f46b4-7b20-4cbf-9ae9-f2819ab414c2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:23.276898 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-602f46b4-7b20-4cbf-9ae9-f2819ab414c2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:23.278044 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-602f46b4-7b20-4cbf-9ae9-f2819ab414c2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1745 microversion: 2.20 time: 0.284192 Jun 29 11:30:23.278594 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 275/537] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:22 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1745 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:30:24.210849 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7296d4ce-ce8e-4a88-8d5a-682e2862bd81 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:24.211445 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7296d4ce-ce8e-4a88-8d5a-682e2862bd81 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:24.217894 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7296d4ce-ce8e-4a88-8d5a-682e2862bd81 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:24.218334 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7296d4ce-ce8e-4a88-8d5a-682e2862bd81 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:24.219076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7296d4ce-ce8e-4a88-8d5a-682e2862bd81 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:24.219500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7296d4ce-ce8e-4a88-8d5a-682e2862bd81 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:24.296120 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c7fa0591-2695-44be-b0e4-2f8530f8f538 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:24.296815 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c7fa0591-2695-44be-b0e4-2f8530f8f538 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:24.304070 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7fa0591-2695-44be-b0e4-2f8530f8f538 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:24.304562 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7fa0591-2695-44be-b0e4-2f8530f8f538 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:24.305378 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7fa0591-2695-44be-b0e4-2f8530f8f538 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:24.305896 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7fa0591-2695-44be-b0e4-2f8530f8f538 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:24.358885 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7296d4ce-ce8e-4a88-8d5a-682e2862bd81 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:24.367466 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7296d4ce-ce8e-4a88-8d5a-682e2862bd81 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1724 microversion: 2.1 time: 0.160465 Jun 29 11:30:24.368122 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 263/538] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:24 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:24.444745 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c7fa0591-2695-44be-b0e4-2f8530f8f538 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:24.452462 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c7fa0591-2695-44be-b0e4-2f8530f8f538 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:24.453950 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c7fa0591-2695-44be-b0e4-2f8530f8f538 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:24.455586 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c7fa0591-2695-44be-b0e4-2f8530f8f538 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1745 microversion: 2.20 time: 0.163371 Jun 29 11:30:24.456232 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 276/539] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:24 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:30:25.384316 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-04cff568-d7fa-49b8-bbb5-d68fbca36831 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:25.384916 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-04cff568-d7fa-49b8-bbb5-d68fbca36831 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:25.391283 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04cff568-d7fa-49b8-bbb5-d68fbca36831 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:25.391722 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04cff568-d7fa-49b8-bbb5-d68fbca36831 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:25.392519 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04cff568-d7fa-49b8-bbb5-d68fbca36831 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:25.392944 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04cff568-d7fa-49b8-bbb5-d68fbca36831 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:25.473822 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-551567d3-2d9f-48a1-a29d-b9b50fe0d76d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:25.474752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-551567d3-2d9f-48a1-a29d-b9b50fe0d76d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:25.477226 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=45 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:30:25.482009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-551567d3-2d9f-48a1-a29d-b9b50fe0d76d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:25.482451 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-551567d3-2d9f-48a1-a29d-b9b50fe0d76d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:25.483336 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-551567d3-2d9f-48a1-a29d-b9b50fe0d76d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:25.483765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-551567d3-2d9f-48a1-a29d-b9b50fe0d76d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:25.537216 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-04cff568-d7fa-49b8-bbb5-d68fbca36831 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:25.545534 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-04cff568-d7fa-49b8-bbb5-d68fbca36831 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1724 microversion: 2.1 time: 0.165135 Jun 29 11:30:25.546085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 264/540] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:25 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:25.622463 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-551567d3-2d9f-48a1-a29d-b9b50fe0d76d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:25.630425 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-551567d3-2d9f-48a1-a29d-b9b50fe0d76d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:25.631991 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-551567d3-2d9f-48a1-a29d-b9b50fe0d76d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:25.633192 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-551567d3-2d9f-48a1-a29d-b9b50fe0d76d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1745 microversion: 2.20 time: 0.163315 Jun 29 11:30:25.633740 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 277/541] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:25 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:26.565511 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bf3210ad-4bf9-4c03-a7ec-688afbb888c4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:26.565511 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bf3210ad-4bf9-4c03-a7ec-688afbb888c4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:26.572145 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf3210ad-4bf9-4c03-a7ec-688afbb888c4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:26.576242 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf3210ad-4bf9-4c03-a7ec-688afbb888c4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:26.576242 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf3210ad-4bf9-4c03-a7ec-688afbb888c4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:26.576242 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf3210ad-4bf9-4c03-a7ec-688afbb888c4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:26.651080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-07a3af2c-11fd-41e1-8b3e-a1739041eec3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:26.651693 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-07a3af2c-11fd-41e1-8b3e-a1739041eec3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:26.658812 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07a3af2c-11fd-41e1-8b3e-a1739041eec3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:26.659265 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07a3af2c-11fd-41e1-8b3e-a1739041eec3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:26.660064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07a3af2c-11fd-41e1-8b3e-a1739041eec3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:26.660499 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07a3af2c-11fd-41e1-8b3e-a1739041eec3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:26.712527 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bf3210ad-4bf9-4c03-a7ec-688afbb888c4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:26.725356 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bf3210ad-4bf9-4c03-a7ec-688afbb888c4 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1724 microversion: 2.1 time: 0.165154 Jun 29 11:30:26.735859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 265/542] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:26 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:26.801333 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-07a3af2c-11fd-41e1-8b3e-a1739041eec3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:26.809576 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-07a3af2c-11fd-41e1-8b3e-a1739041eec3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:26.811081 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-07a3af2c-11fd-41e1-8b3e-a1739041eec3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:26.812262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-07a3af2c-11fd-41e1-8b3e-a1739041eec3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1740 microversion: 2.20 time: 0.165064 Jun 29 11:30:26.812820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 278/543] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:26 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:27.743659 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e9e04d40-3f03-44a1-8835-e434b01a03eb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:27.744301 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e9e04d40-3f03-44a1-8835-e434b01a03eb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:27.750736 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9e04d40-3f03-44a1-8835-e434b01a03eb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:27.751223 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9e04d40-3f03-44a1-8835-e434b01a03eb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:27.752015 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9e04d40-3f03-44a1-8835-e434b01a03eb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:27.752465 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9e04d40-3f03-44a1-8835-e434b01a03eb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:27.832189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b34be39a-d39b-454f-89bb-ea17feb1cf7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:27.833404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b34be39a-d39b-454f-89bb-ea17feb1cf7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:27.853423 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b34be39a-d39b-454f-89bb-ea17feb1cf7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:27.854101 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b34be39a-d39b-454f-89bb-ea17feb1cf7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:27.855000 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b34be39a-d39b-454f-89bb-ea17feb1cf7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:27.855514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b34be39a-d39b-454f-89bb-ea17feb1cf7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:27.942583 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e9e04d40-3f03-44a1-8835-e434b01a03eb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:27.952828 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e9e04d40-3f03-44a1-8835-e434b01a03eb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1730 microversion: 2.1 time: 0.213083 Jun 29 11:30:27.954211 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 266/544] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:27 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:27.988931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-683fcff0-e3d4-4f01-9309-a2856ed0915d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:27.989433 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-683fcff0-e3d4-4f01-9309-a2856ed0915d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:28.001925 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-683fcff0-e3d4-4f01-9309-a2856ed0915d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:28.002648 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-683fcff0-e3d4-4f01-9309-a2856ed0915d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:28.003587 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-683fcff0-e3d4-4f01-9309-a2856ed0915d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:28.004059 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-683fcff0-e3d4-4f01-9309-a2856ed0915d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:28.037362 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b34be39a-d39b-454f-89bb-ea17feb1cf7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:28.050153 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b34be39a-d39b-454f-89bb-ea17feb1cf7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:28.051789 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b34be39a-d39b-454f-89bb-ea17feb1cf7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:28.053227 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b34be39a-d39b-454f-89bb-ea17feb1cf7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1740 microversion: 2.20 time: 0.226576 Jun 29 11:30:28.054321 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 279/545] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:27 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:30:28.101244 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-683fcff0-e3d4-4f01-9309-a2856ed0915d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121224 Jun 29 11:30:28.101911 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 267/546] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jun 29 11:30:27 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:30:29.074792 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2ae91a98-9d1d-4bdd-b75f-8a19e080cdd9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:29.077302 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2ae91a98-9d1d-4bdd-b75f-8a19e080cdd9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:29.084874 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ae91a98-9d1d-4bdd-b75f-8a19e080cdd9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:29.085605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ae91a98-9d1d-4bdd-b75f-8a19e080cdd9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:29.086590 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ae91a98-9d1d-4bdd-b75f-8a19e080cdd9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:29.087267 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ae91a98-9d1d-4bdd-b75f-8a19e080cdd9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:29.270448 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ae91a98-9d1d-4bdd-b75f-8a19e080cdd9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:29.281811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ae91a98-9d1d-4bdd-b75f-8a19e080cdd9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:29.283488 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ae91a98-9d1d-4bdd-b75f-8a19e080cdd9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:29.284699 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2ae91a98-9d1d-4bdd-b75f-8a19e080cdd9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1740 microversion: 2.20 time: 0.214019 Jun 29 11:30:29.288752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 280/547] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:29 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:30:30.007301 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-08b9bd92-0ac4-4d1c-8e5e-0458b5156736 req-627eb489-809b-41ea-89f0-4c7d868d1396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3fb170-5d34-4fa4-8baa-5e404f52f4f2", "tag": "5593c143-d87b-466f-b8ca-17159064e710"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:30:30.019054 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-08b9bd92-0ac4-4d1c-8e5e-0458b5156736 req-627eb489-809b-41ea-89f0-4c7d868d1396 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:30.020196 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-08b9bd92-0ac4-4d1c-8e5e-0458b5156736 req-627eb489-809b-41ea-89f0-4c7d868d1396 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:30.034292 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-08b9bd92-0ac4-4d1c-8e5e-0458b5156736 req-627eb489-809b-41ea-89f0-4c7d868d1396 service nova] Creating event network-changed:5593c143-d87b-466f-b8ca-17159064e710 for instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 on hv-cinder-84733 Jun 29 11:30:30.039763 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-08b9bd92-0ac4-4d1c-8e5e-0458b5156736 req-627eb489-809b-41ea-89f0-4c7d868d1396 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133758 Jun 29 11:30:30.041311 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 268/548] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:30:30.304848 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa50bff3-aea7-4874-af1c-654e68fb18a4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:30.418997 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aa50bff3-aea7-4874-af1c-654e68fb18a4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:30.418997 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa50bff3-aea7-4874-af1c-654e68fb18a4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:30.418997 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa50bff3-aea7-4874-af1c-654e68fb18a4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:30.418997 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa50bff3-aea7-4874-af1c-654e68fb18a4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:30.419581 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa50bff3-aea7-4874-af1c-654e68fb18a4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:30.584861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa50bff3-aea7-4874-af1c-654e68fb18a4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:30.598572 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa50bff3-aea7-4874-af1c-654e68fb18a4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:30.600579 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa50bff3-aea7-4874-af1c-654e68fb18a4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:30.603300 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aa50bff3-aea7-4874-af1c-654e68fb18a4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1740 microversion: 2.20 time: 0.303668 Jun 29 11:30:30.617036 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 281/549] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:30 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:31.622453 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4b6eff9f-3eb0-49bb-bcb6-0d4a69a9bf83 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:31.623384 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4b6eff9f-3eb0-49bb-bcb6-0d4a69a9bf83 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:31.630001 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b6eff9f-3eb0-49bb-bcb6-0d4a69a9bf83 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:31.630673 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b6eff9f-3eb0-49bb-bcb6-0d4a69a9bf83 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:31.631451 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b6eff9f-3eb0-49bb-bcb6-0d4a69a9bf83 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:31.631917 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b6eff9f-3eb0-49bb-bcb6-0d4a69a9bf83 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:31.777273 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4b6eff9f-3eb0-49bb-bcb6-0d4a69a9bf83 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:31.785875 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4b6eff9f-3eb0-49bb-bcb6-0d4a69a9bf83 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:31.787378 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4b6eff9f-3eb0-49bb-bcb6-0d4a69a9bf83 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:31.788601 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4b6eff9f-3eb0-49bb-bcb6-0d4a69a9bf83 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1740 microversion: 2.20 time: 0.171287 Jun 29 11:30:31.799493 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 269/550] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:31 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:32.056438 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-59647bfd-2100-4b3d-a544-88b955bb8542 req-ff3280b3-8ec1-46a3-80f3-90d0e2dfd002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3fb170-5d34-4fa4-8baa-5e404f52f4f2", "tag": "5593c143-d87b-466f-b8ca-17159064e710"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:30:32.067001 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-59647bfd-2100-4b3d-a544-88b955bb8542 req-ff3280b3-8ec1-46a3-80f3-90d0e2dfd002 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:32.074236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-59647bfd-2100-4b3d-a544-88b955bb8542 req-ff3280b3-8ec1-46a3-80f3-90d0e2dfd002 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:32.079626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-59647bfd-2100-4b3d-a544-88b955bb8542 req-ff3280b3-8ec1-46a3-80f3-90d0e2dfd002 service nova] Creating event network-changed:5593c143-d87b-466f-b8ca-17159064e710 for instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 on hv-cinder-84733 Jun 29 11:30:32.084856 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-59647bfd-2100-4b3d-a544-88b955bb8542 req-ff3280b3-8ec1-46a3-80f3-90d0e2dfd002 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031994 Jun 29 11:30:32.085783 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 282/551] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:30:32.372219 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:30:32.372391 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Wed Jun 29 11:30:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:30:32.805677 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9201ff45-1847-4337-b78c-7feb2c486d9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:32.806319 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9201ff45-1847-4337-b78c-7feb2c486d9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:32.813078 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9201ff45-1847-4337-b78c-7feb2c486d9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:32.813531 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9201ff45-1847-4337-b78c-7feb2c486d9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:32.814326 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9201ff45-1847-4337-b78c-7feb2c486d9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:32.814763 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9201ff45-1847-4337-b78c-7feb2c486d9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:32.966257 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9201ff45-1847-4337-b78c-7feb2c486d9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:32.975131 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9201ff45-1847-4337-b78c-7feb2c486d9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:32.976662 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9201ff45-1847-4337-b78c-7feb2c486d9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:32.978319 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9201ff45-1847-4337-b78c-7feb2c486d9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1740 microversion: 2.20 time: 0.176550 Jun 29 11:30:32.978881 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 270/552] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:32 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:33.997898 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-96947fa0-c6ef-40b2-8c44-bfcb90707f4b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:33.998605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-96947fa0-c6ef-40b2-8c44-bfcb90707f4b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:34.005744 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96947fa0-c6ef-40b2-8c44-bfcb90707f4b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:34.006302 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96947fa0-c6ef-40b2-8c44-bfcb90707f4b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:34.007142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96947fa0-c6ef-40b2-8c44-bfcb90707f4b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:34.007666 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96947fa0-c6ef-40b2-8c44-bfcb90707f4b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:34.145155 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96947fa0-c6ef-40b2-8c44-bfcb90707f4b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:34.153839 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96947fa0-c6ef-40b2-8c44-bfcb90707f4b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:34.155341 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96947fa0-c6ef-40b2-8c44-bfcb90707f4b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:34.156535 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-96947fa0-c6ef-40b2-8c44-bfcb90707f4b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1740 microversion: 2.20 time: 0.163447 Jun 29 11:30:34.157090 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 283/553] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:33 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:35.176133 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d4d7d7c4-9aff-4e4a-8f2a-28ce4a7c9bb9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:35.176659 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d4d7d7c4-9aff-4e4a-8f2a-28ce4a7c9bb9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:35.179004 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=55 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:30:35.187976 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4d7d7c4-9aff-4e4a-8f2a-28ce4a7c9bb9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:35.188435 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4d7d7c4-9aff-4e4a-8f2a-28ce4a7c9bb9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:35.189804 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4d7d7c4-9aff-4e4a-8f2a-28ce4a7c9bb9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:35.191059 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4d7d7c4-9aff-4e4a-8f2a-28ce4a7c9bb9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:35.372889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d4d7d7c4-9aff-4e4a-8f2a-28ce4a7c9bb9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:35.388342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d4d7d7c4-9aff-4e4a-8f2a-28ce4a7c9bb9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:35.394683 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d4d7d7c4-9aff-4e4a-8f2a-28ce4a7c9bb9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:35.396805 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d4d7d7c4-9aff-4e4a-8f2a-28ce4a7c9bb9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1740 microversion: 2.20 time: 0.226121 Jun 29 11:30:35.404715 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 271/554] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:35 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:36.418378 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-38866540-9073-4835-a947-93649d3f5e25 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:36.420406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-38866540-9073-4835-a947-93649d3f5e25 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:36.431539 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38866540-9073-4835-a947-93649d3f5e25 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:36.432262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38866540-9073-4835-a947-93649d3f5e25 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:36.432789 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38866540-9073-4835-a947-93649d3f5e25 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:36.433222 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-38866540-9073-4835-a947-93649d3f5e25 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:36.462628 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:30:36.597772 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38866540-9073-4835-a947-93649d3f5e25 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:36.607237 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38866540-9073-4835-a947-93649d3f5e25 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:36.611803 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-38866540-9073-4835-a947-93649d3f5e25 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:36.613265 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-38866540-9073-4835-a947-93649d3f5e25 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1740 microversion: 2.20 time: 0.198799 Jun 29 11:30:36.615436 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 284/555] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:36 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:37.634656 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eac15bac-6fb1-4a8b-bb6f-03627e71c3c8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:37.635306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eac15bac-6fb1-4a8b-bb6f-03627e71c3c8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:37.642688 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eac15bac-6fb1-4a8b-bb6f-03627e71c3c8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:37.643132 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eac15bac-6fb1-4a8b-bb6f-03627e71c3c8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:37.643915 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eac15bac-6fb1-4a8b-bb6f-03627e71c3c8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:37.644346 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eac15bac-6fb1-4a8b-bb6f-03627e71c3c8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:37.781096 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eac15bac-6fb1-4a8b-bb6f-03627e71c3c8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:37.790741 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eac15bac-6fb1-4a8b-bb6f-03627e71c3c8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:37.792377 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eac15bac-6fb1-4a8b-bb6f-03627e71c3c8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:37.793538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eac15bac-6fb1-4a8b-bb6f-03627e71c3c8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1740 microversion: 2.20 time: 0.162896 Jun 29 11:30:37.794088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 272/556] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:37 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:38.813141 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-39d1a883-a153-4a94-b58f-88359c1175a6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:38.815262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-39d1a883-a153-4a94-b58f-88359c1175a6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:38.822875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d1a883-a153-4a94-b58f-88359c1175a6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:38.823328 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d1a883-a153-4a94-b58f-88359c1175a6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:38.824129 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d1a883-a153-4a94-b58f-88359c1175a6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:38.824570 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d1a883-a153-4a94-b58f-88359c1175a6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:38.976488 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-39d1a883-a153-4a94-b58f-88359c1175a6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:38.987217 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-39d1a883-a153-4a94-b58f-88359c1175a6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:38.989104 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-39d1a883-a153-4a94-b58f-88359c1175a6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:38.990267 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-39d1a883-a153-4a94-b58f-88359c1175a6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1740 microversion: 2.20 time: 0.181509 Jun 29 11:30:38.990822 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 285/557] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:38 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:39.125246 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-81627f90-f851-498c-bb03-9a9f5c4f8d2b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:39.125736 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-81627f90-f851-498c-bb03-9a9f5c4f8d2b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:39.132381 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81627f90-f851-498c-bb03-9a9f5c4f8d2b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:39.132968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81627f90-f851-498c-bb03-9a9f5c4f8d2b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:39.133784 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81627f90-f851-498c-bb03-9a9f5c4f8d2b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:39.134208 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81627f90-f851-498c-bb03-9a9f5c4f8d2b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:39.221270 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-81627f90-f851-498c-bb03-9a9f5c4f8d2b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lazy-loading 'services' on Instance uuid 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:30:39.459034 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-81627f90-f851-498c-bb03-9a9f5c4f8d2b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "DELETE /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/os-volume_attachments/dd2552d9-eb1a-45dd-9cb3-027e75cd9092" status: 202 len: 0 microversion: 2.1 time: 0.448833 Jun 29 11:30:39.459675 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 273/558] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jun 29 11:30:39 2022] DELETE /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/os-volume_attachments/dd2552d9-eb1a-45dd-9cb3-027e75cd9092 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 11:30:40.008897 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6cfb9c9d-e224-481a-800f-d2458db760da tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:40.009506 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6cfb9c9d-e224-481a-800f-d2458db760da tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:40.017709 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6cfb9c9d-e224-481a-800f-d2458db760da tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:40.018161 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6cfb9c9d-e224-481a-800f-d2458db760da tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:40.019068 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6cfb9c9d-e224-481a-800f-d2458db760da tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:40.019505 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6cfb9c9d-e224-481a-800f-d2458db760da tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:40.152508 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6cfb9c9d-e224-481a-800f-d2458db760da tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:40.161089 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6cfb9c9d-e224-481a-800f-d2458db760da tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:40.162627 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6cfb9c9d-e224-481a-800f-d2458db760da tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:40.163793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6cfb9c9d-e224-481a-800f-d2458db760da tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1740 microversion: 2.20 time: 0.159011 Jun 29 11:30:40.164395 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 286/559] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:40 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:41.183262 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c0dd52fd-37bd-4a42-bebc-fd23698d4d7e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:41.184065 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c0dd52fd-37bd-4a42-bebc-fd23698d4d7e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:41.190918 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c0dd52fd-37bd-4a42-bebc-fd23698d4d7e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:41.191442 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c0dd52fd-37bd-4a42-bebc-fd23698d4d7e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:41.192338 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c0dd52fd-37bd-4a42-bebc-fd23698d4d7e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:41.192766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c0dd52fd-37bd-4a42-bebc-fd23698d4d7e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:41.377010 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c0dd52fd-37bd-4a42-bebc-fd23698d4d7e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:41.387496 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c0dd52fd-37bd-4a42-bebc-fd23698d4d7e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:41.389082 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c0dd52fd-37bd-4a42-bebc-fd23698d4d7e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:41.390438 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c0dd52fd-37bd-4a42-bebc-fd23698d4d7e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1722 microversion: 2.20 time: 0.211358 Jun 29 11:30:41.391290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 274/560] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:41 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:41.643911 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8501e19-3eef-47b0-b179-2cbbc15080b5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:30:41.652076 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8501e19-3eef-47b0-b179-2cbbc15080b5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:41.652464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8501e19-3eef-47b0-b179-2cbbc15080b5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:41.684767 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8501e19-3eef-47b0-b179-2cbbc15080b5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Going to try to stop instance {{(pid=117920) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 29 11:30:41.816985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8501e19-3eef-47b0-b179-2cbbc15080b5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "POST /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/action" status: 202 len: 0 microversion: 2.1 time: 0.175826 Jun 29 11:30:41.816985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 287/561] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:30:41 2022] POST /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:30:41.822943 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b07449be-e160-4acc-9d45-a872ae8188dc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:41.823649 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b07449be-e160-4acc-9d45-a872ae8188dc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:41.830118 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b07449be-e160-4acc-9d45-a872ae8188dc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:41.830561 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b07449be-e160-4acc-9d45-a872ae8188dc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:41.831325 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b07449be-e160-4acc-9d45-a872ae8188dc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:41.831762 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b07449be-e160-4acc-9d45-a872ae8188dc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:42.030702 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b07449be-e160-4acc-9d45-a872ae8188dc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:42.041130 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b07449be-e160-4acc-9d45-a872ae8188dc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.221956 Jun 29 11:30:42.043570 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 275/562] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:41 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:42.411142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c2492b19-7a3d-49c7-9bc0-df4b1174f1c9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:42.411751 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c2492b19-7a3d-49c7-9bc0-df4b1174f1c9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:42.417946 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2492b19-7a3d-49c7-9bc0-df4b1174f1c9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:42.418348 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2492b19-7a3d-49c7-9bc0-df4b1174f1c9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:42.419084 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2492b19-7a3d-49c7-9bc0-df4b1174f1c9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:42.419506 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2492b19-7a3d-49c7-9bc0-df4b1174f1c9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:42.564566 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c2492b19-7a3d-49c7-9bc0-df4b1174f1c9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:42.564566 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c2492b19-7a3d-49c7-9bc0-df4b1174f1c9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:42.564816 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c2492b19-7a3d-49c7-9bc0-df4b1174f1c9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:42.566040 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c2492b19-7a3d-49c7-9bc0-df4b1174f1c9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1722 microversion: 2.20 time: 0.159864 Jun 29 11:30:42.566795 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 288/563] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:42 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:43.051011 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-d083956c-9d8b-4b30-aae5-ad7feb5c6813 req-50e7e332-151b-4942-b04c-d945ebe1bf20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde34fdf-bfe6-48a4-9b9e-95ff879ffa70", "name": "network-vif-unplugged", "status": "completed", "tag": "dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:30:43.059979 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce0cb4fb-5bfd-4b65-ad45-1fa34f1e856d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:43.060586 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce0cb4fb-5bfd-4b65-ad45-1fa34f1e856d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:43.061840 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-d083956c-9d8b-4b30-aae5-ad7feb5c6813 req-50e7e332-151b-4942-b04c-d945ebe1bf20 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:43.062288 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-d083956c-9d8b-4b30-aae5-ad7feb5c6813 req-50e7e332-151b-4942-b04c-d945ebe1bf20 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:43.067063 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce0cb4fb-5bfd-4b65-ad45-1fa34f1e856d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:43.070651 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce0cb4fb-5bfd-4b65-ad45-1fa34f1e856d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:43.070651 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce0cb4fb-5bfd-4b65-ad45-1fa34f1e856d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:43.070651 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce0cb4fb-5bfd-4b65-ad45-1fa34f1e856d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:43.073822 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-d083956c-9d8b-4b30-aae5-ad7feb5c6813 req-50e7e332-151b-4942-b04c-d945ebe1bf20 service nova] Creating event network-vif-unplugged:dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48 for instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 on hv-cinder-84733 Jun 29 11:30:43.078866 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-d083956c-9d8b-4b30-aae5-ad7feb5c6813 req-50e7e332-151b-4942-b04c-d945ebe1bf20 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032175 Jun 29 11:30:43.079486 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 276/564] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:30:43.208520 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ce0cb4fb-5bfd-4b65-ad45-1fa34f1e856d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:43.216198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce0cb4fb-5bfd-4b65-ad45-1fa34f1e856d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.160095 Jun 29 11:30:43.216964 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 289/565] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:43 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:30:43.585605 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4942d815-91c0-4953-b0f4-7eb37b3f36d0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:43.586289 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4942d815-91c0-4953-b0f4-7eb37b3f36d0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:43.592596 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4942d815-91c0-4953-b0f4-7eb37b3f36d0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:43.593033 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4942d815-91c0-4953-b0f4-7eb37b3f36d0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:43.593775 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4942d815-91c0-4953-b0f4-7eb37b3f36d0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:43.594199 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4942d815-91c0-4953-b0f4-7eb37b3f36d0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:43.600092 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:30:43.736537 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4942d815-91c0-4953-b0f4-7eb37b3f36d0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:43.744446 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4942d815-91c0-4953-b0f4-7eb37b3f36d0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:43.745949 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4942d815-91c0-4953-b0f4-7eb37b3f36d0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:43.747088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4942d815-91c0-4953-b0f4-7eb37b3f36d0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1722 microversion: 2.20 time: 0.165898 Jun 29 11:30:43.747635 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 277/566] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:43 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:30:44.234365 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4ca378ae-90ba-4fcc-b85d-a1cd8c97b441 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:44.234973 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4ca378ae-90ba-4fcc-b85d-a1cd8c97b441 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:44.241528 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ca378ae-90ba-4fcc-b85d-a1cd8c97b441 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:44.242023 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ca378ae-90ba-4fcc-b85d-a1cd8c97b441 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:44.242735 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ca378ae-90ba-4fcc-b85d-a1cd8c97b441 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:44.243175 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4ca378ae-90ba-4fcc-b85d-a1cd8c97b441 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:44.477322 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4ca378ae-90ba-4fcc-b85d-a1cd8c97b441 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:44.484745 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4ca378ae-90ba-4fcc-b85d-a1cd8c97b441 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.254212 Jun 29 11:30:44.485309 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 290/567] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:44 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:44.771983 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-66b8c1d4-d260-410a-9f21-a10eec7c1138 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:44.771983 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-66b8c1d4-d260-410a-9f21-a10eec7c1138 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:44.775240 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-66b8c1d4-d260-410a-9f21-a10eec7c1138 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:44.775240 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-66b8c1d4-d260-410a-9f21-a10eec7c1138 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:44.775424 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-66b8c1d4-d260-410a-9f21-a10eec7c1138 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:44.776008 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-66b8c1d4-d260-410a-9f21-a10eec7c1138 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:44.911967 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-66b8c1d4-d260-410a-9f21-a10eec7c1138 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:44.921253 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-66b8c1d4-d260-410a-9f21-a10eec7c1138 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:44.922321 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-66b8c1d4-d260-410a-9f21-a10eec7c1138 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:44.923507 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-66b8c1d4-d260-410a-9f21-a10eec7c1138 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1725 microversion: 2.20 time: 0.161270 Jun 29 11:30:44.924156 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 278/568] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:44 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:44.942203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a66542af-fc5f-44b1-bf6f-240af5f51848 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6d12d93-eb44-4e33-bab7-3b94be9569eb"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:30:44.943319 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a66542af-fc5f-44b1-bf6f-240af5f51848 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:44.949402 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a66542af-fc5f-44b1-bf6f-240af5f51848 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:44.949846 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a66542af-fc5f-44b1-bf6f-240af5f51848 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:44.950599 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a66542af-fc5f-44b1-bf6f-240af5f51848 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:44.951036 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a66542af-fc5f-44b1-bf6f-240af5f51848 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:45.502948 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-74339f19-5d0b-4927-9ea5-82a60bd11bdb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:45.503550 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-74339f19-5d0b-4927-9ea5-82a60bd11bdb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:45.509874 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-74339f19-5d0b-4927-9ea5-82a60bd11bdb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:45.510313 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-74339f19-5d0b-4927-9ea5-82a60bd11bdb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:45.511144 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-74339f19-5d0b-4927-9ea5-82a60bd11bdb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:45.511566 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-74339f19-5d0b-4927-9ea5-82a60bd11bdb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:45.640270 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-74339f19-5d0b-4927-9ea5-82a60bd11bdb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:45.648219 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-74339f19-5d0b-4927-9ea5-82a60bd11bdb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.149668 Jun 29 11:30:45.648840 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 279/569] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:45 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:30:45.992827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a66542af-fc5f-44b1-bf6f-240af5f51848 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "POST /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.055579 Jun 29 11:30:45.993377 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 291/570] 10.222.0.44 () {62 vars in 1363 bytes} [Wed Jun 29 11:30:44 2022] POST /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-volume_attachments => generated 188 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:30:46.105598 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-785c2841-be1c-4892-ae88-8775ace85f33 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:30:46.106153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-785c2841-be1c-4892-ae88-8775ace85f33 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:46.113057 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-785c2841-be1c-4892-ae88-8775ace85f33 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:46.113491 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-785c2841-be1c-4892-ae88-8775ace85f33 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:46.114231 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-785c2841-be1c-4892-ae88-8775ace85f33 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:46.114658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-785c2841-be1c-4892-ae88-8775ace85f33 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:46.314539 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-785c2841-be1c-4892-ae88-8775ace85f33 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "POST /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/action" status: 202 len: 0 microversion: 2.20 time: 0.212639 Jun 29 11:30:46.315056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 280/571] 10.222.0.44 () {62 vars in 1318 bytes} [Wed Jun 29 11:30:46 2022] POST /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:30:46.323121 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1791b465-59b0-4d6e-b600-4d519208f093 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:46.323729 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1791b465-59b0-4d6e-b600-4d519208f093 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:46.331210 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1791b465-59b0-4d6e-b600-4d519208f093 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:46.331666 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1791b465-59b0-4d6e-b600-4d519208f093 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:46.332453 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1791b465-59b0-4d6e-b600-4d519208f093 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:46.332890 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1791b465-59b0-4d6e-b600-4d519208f093 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:46.467727 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1791b465-59b0-4d6e-b600-4d519208f093 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:46.476795 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1791b465-59b0-4d6e-b600-4d519208f093 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:46.478317 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1791b465-59b0-4d6e-b600-4d519208f093 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:46.479449 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1791b465-59b0-4d6e-b600-4d519208f093 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1751 microversion: 2.20 time: 0.160244 Jun 29 11:30:46.480019 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 292/572] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:46 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:46.657999 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9767c17a-18e8-46c6-bbd1-547177eb8df5 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:30:46.658914 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9767c17a-18e8-46c6-bbd1-547177eb8df5 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:46.665121 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9767c17a-18e8-46c6-bbd1-547177eb8df5 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:46.665350 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3686ad9b-2637-46b0-ac00-5ef6b82b8d12 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:46.665571 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9767c17a-18e8-46c6-bbd1-547177eb8df5 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:46.665954 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3686ad9b-2637-46b0-ac00-5ef6b82b8d12 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:46.666335 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9767c17a-18e8-46c6-bbd1-547177eb8df5 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:46.666774 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9767c17a-18e8-46c6-bbd1-547177eb8df5 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:46.671915 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3686ad9b-2637-46b0-ac00-5ef6b82b8d12 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:46.672357 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3686ad9b-2637-46b0-ac00-5ef6b82b8d12 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:46.673101 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3686ad9b-2637-46b0-ac00-5ef6b82b8d12 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:46.673568 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3686ad9b-2637-46b0-ac00-5ef6b82b8d12 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:46.807192 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3686ad9b-2637-46b0-ac00-5ef6b82b8d12 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:46.815339 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3686ad9b-2637-46b0-ac00-5ef6b82b8d12 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.153941 Jun 29 11:30:46.815932 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 293/573] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:46 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:46.854138 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9767c17a-18e8-46c6-bbd1-547177eb8df5 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "POST /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/action" status: 202 len: 0 microversion: 2.1 time: 0.200048 Jun 29 11:30:46.854840 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 281/574] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:30:46 2022] POST /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:30:46.862723 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a24f2619-8321-4dc5-8c24-3e6b99c38c8a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:46.866509 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a24f2619-8321-4dc5-8c24-3e6b99c38c8a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:46.869321 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a24f2619-8321-4dc5-8c24-3e6b99c38c8a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:46.869768 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a24f2619-8321-4dc5-8c24-3e6b99c38c8a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:46.870525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a24f2619-8321-4dc5-8c24-3e6b99c38c8a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:46.870955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a24f2619-8321-4dc5-8c24-3e6b99c38c8a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:47.062498 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a24f2619-8321-4dc5-8c24-3e6b99c38c8a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:47.070979 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a24f2619-8321-4dc5-8c24-3e6b99c38c8a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1749 microversion: 2.1 time: 0.212155 Jun 29 11:30:47.071545 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 294/575] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:46 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1749 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:47.499213 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f0e06621-bd9d-4d05-807d-dc596af923ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:47.500014 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f0e06621-bd9d-4d05-807d-dc596af923ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:47.506532 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0e06621-bd9d-4d05-807d-dc596af923ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:47.507046 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0e06621-bd9d-4d05-807d-dc596af923ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:47.507897 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0e06621-bd9d-4d05-807d-dc596af923ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:47.508563 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0e06621-bd9d-4d05-807d-dc596af923ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:47.649387 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f0e06621-bd9d-4d05-807d-dc596af923ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:47.658677 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f0e06621-bd9d-4d05-807d-dc596af923ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:47.660732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f0e06621-bd9d-4d05-807d-dc596af923ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:47.663132 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f0e06621-bd9d-4d05-807d-dc596af923ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1751 microversion: 2.20 time: 0.168367 Jun 29 11:30:47.663702 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 282/576] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:47 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:47.832865 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a264707d-d5fc-4489-8d9e-ed4d33a65d2e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:47.833399 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a264707d-d5fc-4489-8d9e-ed4d33a65d2e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:47.840374 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a264707d-d5fc-4489-8d9e-ed4d33a65d2e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:47.840824 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a264707d-d5fc-4489-8d9e-ed4d33a65d2e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:47.841586 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a264707d-d5fc-4489-8d9e-ed4d33a65d2e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:47.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a264707d-d5fc-4489-8d9e-ed4d33a65d2e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:47.978319 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a264707d-d5fc-4489-8d9e-ed4d33a65d2e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:47.985714 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a264707d-d5fc-4489-8d9e-ed4d33a65d2e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.157309 Jun 29 11:30:47.986276 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 295/577] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:47 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:48.094742 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fb70482e-70c5-4210-b9f1-a56c64fcedc1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:48.095361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fb70482e-70c5-4210-b9f1-a56c64fcedc1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:48.101698 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb70482e-70c5-4210-b9f1-a56c64fcedc1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:48.102142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb70482e-70c5-4210-b9f1-a56c64fcedc1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:48.102901 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb70482e-70c5-4210-b9f1-a56c64fcedc1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:48.103330 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fb70482e-70c5-4210-b9f1-a56c64fcedc1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:48.249603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fb70482e-70c5-4210-b9f1-a56c64fcedc1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:48.258010 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fb70482e-70c5-4210-b9f1-a56c64fcedc1 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.173756 Jun 29 11:30:48.258562 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 283/578] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:48 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:48.682457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6547db85-47ce-492e-8480-442781a3d459 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:48.683064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6547db85-47ce-492e-8480-442781a3d459 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:48.690028 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6547db85-47ce-492e-8480-442781a3d459 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:48.690470 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6547db85-47ce-492e-8480-442781a3d459 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:48.691218 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6547db85-47ce-492e-8480-442781a3d459 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:48.691644 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6547db85-47ce-492e-8480-442781a3d459 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:48.821740 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6547db85-47ce-492e-8480-442781a3d459 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:48.829999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6547db85-47ce-492e-8480-442781a3d459 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:48.832292 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6547db85-47ce-492e-8480-442781a3d459 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:48.833432 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6547db85-47ce-492e-8480-442781a3d459 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1753 microversion: 2.20 time: 0.154891 Jun 29 11:30:48.833981 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 296/579] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:48 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:49.009134 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ff531a26-8705-4c97-b4ec-04ecffeef848 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:49.009134 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ff531a26-8705-4c97-b4ec-04ecffeef848 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:49.010502 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff531a26-8705-4c97-b4ec-04ecffeef848 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:49.011755 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff531a26-8705-4c97-b4ec-04ecffeef848 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:49.012898 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff531a26-8705-4c97-b4ec-04ecffeef848 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:49.013475 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff531a26-8705-4c97-b4ec-04ecffeef848 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:49.147083 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ff531a26-8705-4c97-b4ec-04ecffeef848 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:49.154498 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ff531a26-8705-4c97-b4ec-04ecffeef848 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.155857 Jun 29 11:30:49.155060 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 284/580] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:48 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:49.275474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-43cf541b-1c5f-4bfc-aa29-0f86a9a1df67 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:49.276210 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-43cf541b-1c5f-4bfc-aa29-0f86a9a1df67 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:49.282445 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43cf541b-1c5f-4bfc-aa29-0f86a9a1df67 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:49.282894 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43cf541b-1c5f-4bfc-aa29-0f86a9a1df67 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:49.284281 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43cf541b-1c5f-4bfc-aa29-0f86a9a1df67 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:49.284716 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43cf541b-1c5f-4bfc-aa29-0f86a9a1df67 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:49.305487 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:30:49.432790 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-43cf541b-1c5f-4bfc-aa29-0f86a9a1df67 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:49.440456 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-43cf541b-1c5f-4bfc-aa29-0f86a9a1df67 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.168744 Jun 29 11:30:49.441011 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 297/581] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:49 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:49.851737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5db734ed-2e55-4467-af74-1b4972d6d900 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:49.852464 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5db734ed-2e55-4467-af74-1b4972d6d900 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:49.858704 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5db734ed-2e55-4467-af74-1b4972d6d900 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:49.859139 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5db734ed-2e55-4467-af74-1b4972d6d900 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:49.859906 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5db734ed-2e55-4467-af74-1b4972d6d900 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:49.860335 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5db734ed-2e55-4467-af74-1b4972d6d900 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:50.017837 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5db734ed-2e55-4467-af74-1b4972d6d900 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:50.026229 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5db734ed-2e55-4467-af74-1b4972d6d900 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:50.027711 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5db734ed-2e55-4467-af74-1b4972d6d900 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:50.028880 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5db734ed-2e55-4467-af74-1b4972d6d900 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.181285 Jun 29 11:30:50.029440 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 285/582] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:49 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:50.171819 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5f6d8e2f-d88e-4d8b-83a2-384ca5a63306 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:50.172447 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5f6d8e2f-d88e-4d8b-83a2-384ca5a63306 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:50.179294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f6d8e2f-d88e-4d8b-83a2-384ca5a63306 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:50.179739 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f6d8e2f-d88e-4d8b-83a2-384ca5a63306 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:50.180513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f6d8e2f-d88e-4d8b-83a2-384ca5a63306 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:50.180943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f6d8e2f-d88e-4d8b-83a2-384ca5a63306 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:50.364865 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5f6d8e2f-d88e-4d8b-83a2-384ca5a63306 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:50.372882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5f6d8e2f-d88e-4d8b-83a2-384ca5a63306 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.204813 Jun 29 11:30:50.375482 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 298/583] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:50 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:50.457588 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-48c107d5-7cb3-4c2f-8eb3-400997510f6f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:50.458200 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-48c107d5-7cb3-4c2f-8eb3-400997510f6f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:50.464397 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-48c107d5-7cb3-4c2f-8eb3-400997510f6f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:50.464837 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-48c107d5-7cb3-4c2f-8eb3-400997510f6f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:50.465625 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-48c107d5-7cb3-4c2f-8eb3-400997510f6f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:50.466050 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-48c107d5-7cb3-4c2f-8eb3-400997510f6f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:50.691276 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-48c107d5-7cb3-4c2f-8eb3-400997510f6f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:50.699901 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-48c107d5-7cb3-4c2f-8eb3-400997510f6f tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.246307 Jun 29 11:30:50.700469 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 286/584] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:50 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:51.046513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa035955-225d-4ae2-8a02-7819968f369d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:51.047058 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aa035955-225d-4ae2-8a02-7819968f369d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:51.052918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa035955-225d-4ae2-8a02-7819968f369d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:51.053360 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa035955-225d-4ae2-8a02-7819968f369d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:51.054104 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa035955-225d-4ae2-8a02-7819968f369d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:51.054535 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa035955-225d-4ae2-8a02-7819968f369d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:51.186872 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa035955-225d-4ae2-8a02-7819968f369d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:51.195740 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa035955-225d-4ae2-8a02-7819968f369d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:51.197267 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa035955-225d-4ae2-8a02-7819968f369d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:51.198410 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aa035955-225d-4ae2-8a02-7819968f369d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.155898 Jun 29 11:30:51.199011 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 299/585] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:51 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:51.395596 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c507c104-54c7-4e04-9e2e-a8da66ab593f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:51.396349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c507c104-54c7-4e04-9e2e-a8da66ab593f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:51.417551 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c507c104-54c7-4e04-9e2e-a8da66ab593f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:51.418076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c507c104-54c7-4e04-9e2e-a8da66ab593f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:51.418854 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c507c104-54c7-4e04-9e2e-a8da66ab593f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:51.419451 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c507c104-54c7-4e04-9e2e-a8da66ab593f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:51.577924 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c507c104-54c7-4e04-9e2e-a8da66ab593f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:51.586964 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c507c104-54c7-4e04-9e2e-a8da66ab593f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.196374 Jun 29 11:30:51.588208 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 287/586] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:51 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:51.719038 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bc4a1028-fc38-4e9c-8f86-098e08c2e091 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:51.719646 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bc4a1028-fc38-4e9c-8f86-098e08c2e091 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:51.727280 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc4a1028-fc38-4e9c-8f86-098e08c2e091 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:51.727664 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc4a1028-fc38-4e9c-8f86-098e08c2e091 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:51.736935 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc4a1028-fc38-4e9c-8f86-098e08c2e091 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:51.737639 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc4a1028-fc38-4e9c-8f86-098e08c2e091 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:51.904881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bc4a1028-fc38-4e9c-8f86-098e08c2e091 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:51.917809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bc4a1028-fc38-4e9c-8f86-098e08c2e091 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.202398 Jun 29 11:30:51.918677 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 300/587] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:51 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:52.217539 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6e885c2e-4dda-4646-bca2-03d28a23130d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:52.218249 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6e885c2e-4dda-4646-bca2-03d28a23130d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:52.225200 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e885c2e-4dda-4646-bca2-03d28a23130d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:52.225645 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e885c2e-4dda-4646-bca2-03d28a23130d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:52.226399 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e885c2e-4dda-4646-bca2-03d28a23130d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:52.226839 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e885c2e-4dda-4646-bca2-03d28a23130d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:52.364827 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6e885c2e-4dda-4646-bca2-03d28a23130d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:52.373075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6e885c2e-4dda-4646-bca2-03d28a23130d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:52.374571 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6e885c2e-4dda-4646-bca2-03d28a23130d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:52.375711 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6e885c2e-4dda-4646-bca2-03d28a23130d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.162303 Jun 29 11:30:52.376343 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 288/588] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:52 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:52.605711 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eeb02fd0-e521-400b-a996-0b5d6b4e80e5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:52.607051 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eeb02fd0-e521-400b-a996-0b5d6b4e80e5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:52.614474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eeb02fd0-e521-400b-a996-0b5d6b4e80e5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:52.615236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eeb02fd0-e521-400b-a996-0b5d6b4e80e5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:52.616212 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eeb02fd0-e521-400b-a996-0b5d6b4e80e5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:52.616644 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eeb02fd0-e521-400b-a996-0b5d6b4e80e5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:52.745898 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eeb02fd0-e521-400b-a996-0b5d6b4e80e5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:52.753913 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eeb02fd0-e521-400b-a996-0b5d6b4e80e5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.152607 Jun 29 11:30:52.754474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 301/589] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:52 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:52.934796 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-81910dce-77f2-44df-b665-8dd10f62cd32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:52.935391 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-81910dce-77f2-44df-b665-8dd10f62cd32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:52.942360 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81910dce-77f2-44df-b665-8dd10f62cd32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:52.942799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81910dce-77f2-44df-b665-8dd10f62cd32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:52.943541 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81910dce-77f2-44df-b665-8dd10f62cd32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:52.943995 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81910dce-77f2-44df-b665-8dd10f62cd32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:53.101241 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-81910dce-77f2-44df-b665-8dd10f62cd32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:53.109170 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-81910dce-77f2-44df-b665-8dd10f62cd32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.178580 Jun 29 11:30:53.109740 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 289/590] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:52 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:53.394866 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ee75ec6d-1f97-47b2-b68c-4db1efdabafe tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:53.395491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ee75ec6d-1f97-47b2-b68c-4db1efdabafe tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:53.402503 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee75ec6d-1f97-47b2-b68c-4db1efdabafe tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:53.403070 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee75ec6d-1f97-47b2-b68c-4db1efdabafe tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:53.403947 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee75ec6d-1f97-47b2-b68c-4db1efdabafe tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:53.404483 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee75ec6d-1f97-47b2-b68c-4db1efdabafe tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:53.559522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee75ec6d-1f97-47b2-b68c-4db1efdabafe tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:53.570353 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee75ec6d-1f97-47b2-b68c-4db1efdabafe tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:53.572349 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee75ec6d-1f97-47b2-b68c-4db1efdabafe tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:53.573779 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ee75ec6d-1f97-47b2-b68c-4db1efdabafe tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.182832 Jun 29 11:30:53.574558 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 302/591] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:53 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:53.771302 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-196bd167-9188-4ccd-a028-fc0bd7404837 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:53.771975 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-196bd167-9188-4ccd-a028-fc0bd7404837 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:53.778603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-196bd167-9188-4ccd-a028-fc0bd7404837 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:53.779057 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-196bd167-9188-4ccd-a028-fc0bd7404837 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:53.779859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-196bd167-9188-4ccd-a028-fc0bd7404837 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:53.780312 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-196bd167-9188-4ccd-a028-fc0bd7404837 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:53.924754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-196bd167-9188-4ccd-a028-fc0bd7404837 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:53.932199 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-196bd167-9188-4ccd-a028-fc0bd7404837 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.165257 Jun 29 11:30:53.932766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 290/592] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:53 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:54.126687 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b4d5195a-16ca-4792-9fbd-51a7fe20e840 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:54.127918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b4d5195a-16ca-4792-9fbd-51a7fe20e840 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:54.136348 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4d5195a-16ca-4792-9fbd-51a7fe20e840 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:54.136822 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4d5195a-16ca-4792-9fbd-51a7fe20e840 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:54.137579 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4d5195a-16ca-4792-9fbd-51a7fe20e840 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:54.137999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4d5195a-16ca-4792-9fbd-51a7fe20e840 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:54.297578 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b4d5195a-16ca-4792-9fbd-51a7fe20e840 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:54.305524 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b4d5195a-16ca-4792-9fbd-51a7fe20e840 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.182879 Jun 29 11:30:54.306090 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 303/593] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:54 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:54.592616 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-22a42eea-143c-455a-bf31-b7a1069bb0f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:54.593229 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-22a42eea-143c-455a-bf31-b7a1069bb0f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:54.599183 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-22a42eea-143c-455a-bf31-b7a1069bb0f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:54.599620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-22a42eea-143c-455a-bf31-b7a1069bb0f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:54.600665 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-22a42eea-143c-455a-bf31-b7a1069bb0f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:54.601105 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-22a42eea-143c-455a-bf31-b7a1069bb0f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:54.743818 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-22a42eea-143c-455a-bf31-b7a1069bb0f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:54.747308 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:30:54.755218 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-22a42eea-143c-455a-bf31-b7a1069bb0f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:54.755218 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-22a42eea-143c-455a-bf31-b7a1069bb0f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:54.755729 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-22a42eea-143c-455a-bf31-b7a1069bb0f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.167037 Jun 29 11:30:54.756311 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 291/594] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:54 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:54.949481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cd582b51-1e56-4fa6-a723-923a2e5e6b60 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:54.950103 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cd582b51-1e56-4fa6-a723-923a2e5e6b60 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:54.957435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd582b51-1e56-4fa6-a723-923a2e5e6b60 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:54.957889 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd582b51-1e56-4fa6-a723-923a2e5e6b60 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:54.958661 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd582b51-1e56-4fa6-a723-923a2e5e6b60 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:54.959097 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd582b51-1e56-4fa6-a723-923a2e5e6b60 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:55.106964 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cd582b51-1e56-4fa6-a723-923a2e5e6b60 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:55.120384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cd582b51-1e56-4fa6-a723-923a2e5e6b60 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.174517 Jun 29 11:30:55.121086 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 304/595] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:54 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:55.322365 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d566f61e-9d7f-4dd8-882a-28810cef7c32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:55.323000 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d566f61e-9d7f-4dd8-882a-28810cef7c32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:55.330092 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d566f61e-9d7f-4dd8-882a-28810cef7c32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:55.330539 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d566f61e-9d7f-4dd8-882a-28810cef7c32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:55.331298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d566f61e-9d7f-4dd8-882a-28810cef7c32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:55.331731 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d566f61e-9d7f-4dd8-882a-28810cef7c32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:55.477210 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d566f61e-9d7f-4dd8-882a-28810cef7c32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:55.485053 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d566f61e-9d7f-4dd8-882a-28810cef7c32 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.166553 Jun 29 11:30:55.485625 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 292/596] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:55 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:55.777457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-396b5ff1-5e22-497c-9567-1592c1bfdb9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:55.778269 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-396b5ff1-5e22-497c-9567-1592c1bfdb9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:55.788208 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=56 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:30:55.790162 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-396b5ff1-5e22-497c-9567-1592c1bfdb9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:55.790653 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-396b5ff1-5e22-497c-9567-1592c1bfdb9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:55.791529 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-396b5ff1-5e22-497c-9567-1592c1bfdb9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:55.792094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-396b5ff1-5e22-497c-9567-1592c1bfdb9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:55.951066 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-396b5ff1-5e22-497c-9567-1592c1bfdb9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:55.960971 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-396b5ff1-5e22-497c-9567-1592c1bfdb9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:55.962523 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-396b5ff1-5e22-497c-9567-1592c1bfdb9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:55.963694 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-396b5ff1-5e22-497c-9567-1592c1bfdb9f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.191773 Jun 29 11:30:55.964299 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 305/597] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:55 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:56.139972 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-313e0fc2-7809-477e-af87-e8e30770c8a6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:56.140603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-313e0fc2-7809-477e-af87-e8e30770c8a6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:56.147332 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-313e0fc2-7809-477e-af87-e8e30770c8a6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:56.147774 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-313e0fc2-7809-477e-af87-e8e30770c8a6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:56.148962 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-313e0fc2-7809-477e-af87-e8e30770c8a6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:56.149405 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-313e0fc2-7809-477e-af87-e8e30770c8a6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:56.292754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-313e0fc2-7809-477e-af87-e8e30770c8a6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:56.300315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-313e0fc2-7809-477e-af87-e8e30770c8a6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.164858 Jun 29 11:30:56.301079 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 293/598] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:56 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:56.517882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f66d06d-a967-40ef-b86f-aa6e4c4c7ae8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:56.517882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8f66d06d-a967-40ef-b86f-aa6e4c4c7ae8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:56.517882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f66d06d-a967-40ef-b86f-aa6e4c4c7ae8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:56.517882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f66d06d-a967-40ef-b86f-aa6e4c4c7ae8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:56.518954 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f66d06d-a967-40ef-b86f-aa6e4c4c7ae8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:56.518954 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f66d06d-a967-40ef-b86f-aa6e4c4c7ae8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:56.677294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8f66d06d-a967-40ef-b86f-aa6e4c4c7ae8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:56.686706 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8f66d06d-a967-40ef-b86f-aa6e4c4c7ae8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.187950 Jun 29 11:30:56.687318 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 306/599] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:56 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:56.985055 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f565d270-830a-493a-b66e-74c23947f20e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:56.985849 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f565d270-830a-493a-b66e-74c23947f20e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:56.993061 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f565d270-830a-493a-b66e-74c23947f20e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:56.993509 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f565d270-830a-493a-b66e-74c23947f20e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:56.994271 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f565d270-830a-493a-b66e-74c23947f20e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:56.994700 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f565d270-830a-493a-b66e-74c23947f20e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:57.139032 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f565d270-830a-493a-b66e-74c23947f20e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:57.147939 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f565d270-830a-493a-b66e-74c23947f20e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:57.149480 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f565d270-830a-493a-b66e-74c23947f20e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:57.150638 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f565d270-830a-493a-b66e-74c23947f20e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.169703 Jun 29 11:30:57.151450 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 294/600] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:56 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:57.317448 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d0975d6d-d4e9-4cee-8093-55ac5e640ec2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:57.318033 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d0975d6d-d4e9-4cee-8093-55ac5e640ec2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:57.324786 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0975d6d-d4e9-4cee-8093-55ac5e640ec2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:57.325149 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0975d6d-d4e9-4cee-8093-55ac5e640ec2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:57.325916 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0975d6d-d4e9-4cee-8093-55ac5e640ec2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:57.326351 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0975d6d-d4e9-4cee-8093-55ac5e640ec2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:57.454787 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d0975d6d-d4e9-4cee-8093-55ac5e640ec2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:57.463113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d0975d6d-d4e9-4cee-8093-55ac5e640ec2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.149461 Jun 29 11:30:57.463915 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 307/601] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:57 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:57.705400 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-69462a2f-a0d0-4c94-92a4-3cb25015a80e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:57.706637 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-69462a2f-a0d0-4c94-92a4-3cb25015a80e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:57.713541 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-69462a2f-a0d0-4c94-92a4-3cb25015a80e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:57.714043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-69462a2f-a0d0-4c94-92a4-3cb25015a80e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:57.714904 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-69462a2f-a0d0-4c94-92a4-3cb25015a80e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:57.715269 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-69462a2f-a0d0-4c94-92a4-3cb25015a80e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:57.870936 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-69462a2f-a0d0-4c94-92a4-3cb25015a80e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:57.879686 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-69462a2f-a0d0-4c94-92a4-3cb25015a80e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.178515 Jun 29 11:30:57.880451 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 295/602] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:57 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:58.169693 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-021ea5bc-657d-44d4-9d38-097546439c9a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:58.170261 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-021ea5bc-657d-44d4-9d38-097546439c9a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:58.177567 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-021ea5bc-657d-44d4-9d38-097546439c9a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:58.178047 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-021ea5bc-657d-44d4-9d38-097546439c9a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:58.178837 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-021ea5bc-657d-44d4-9d38-097546439c9a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:58.179272 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-021ea5bc-657d-44d4-9d38-097546439c9a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:58.313514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-021ea5bc-657d-44d4-9d38-097546439c9a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:58.323361 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-021ea5bc-657d-44d4-9d38-097546439c9a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:58.324993 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-021ea5bc-657d-44d4-9d38-097546439c9a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:58.326238 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-021ea5bc-657d-44d4-9d38-097546439c9a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.160782 Jun 29 11:30:58.326816 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 308/603] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:58 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:58.482324 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7234885a-8c84-4f23-bb49-2af26dabc41b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:58.483988 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7234885a-8c84-4f23-bb49-2af26dabc41b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:58.492312 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7234885a-8c84-4f23-bb49-2af26dabc41b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:58.492968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7234885a-8c84-4f23-bb49-2af26dabc41b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:58.494606 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7234885a-8c84-4f23-bb49-2af26dabc41b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:58.495115 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7234885a-8c84-4f23-bb49-2af26dabc41b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:58.634324 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7234885a-8c84-4f23-bb49-2af26dabc41b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:58.641953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7234885a-8c84-4f23-bb49-2af26dabc41b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.164157 Jun 29 11:30:58.642783 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 296/604] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:58 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:58.898768 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-323085f0-8339-4059-86f8-1abd235605e6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:58.899370 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-323085f0-8339-4059-86f8-1abd235605e6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:58.905470 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-323085f0-8339-4059-86f8-1abd235605e6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:58.905914 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-323085f0-8339-4059-86f8-1abd235605e6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:58.906661 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-323085f0-8339-4059-86f8-1abd235605e6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:58.907089 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-323085f0-8339-4059-86f8-1abd235605e6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:59.061666 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-323085f0-8339-4059-86f8-1abd235605e6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:59.070101 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-323085f0-8339-4059-86f8-1abd235605e6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.175044 Jun 29 11:30:59.070681 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 309/605] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:58 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:30:59.344478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5e051fe5-a4fb-484d-ba73-ba73fc426ec6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:59.345174 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5e051fe5-a4fb-484d-ba73-ba73fc426ec6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:59.352516 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e051fe5-a4fb-484d-ba73-ba73fc426ec6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:59.352968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e051fe5-a4fb-484d-ba73-ba73fc426ec6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:59.353806 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e051fe5-a4fb-484d-ba73-ba73fc426ec6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:59.354314 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e051fe5-a4fb-484d-ba73-ba73fc426ec6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:59.505697 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5e051fe5-a4fb-484d-ba73-ba73fc426ec6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:59.515705 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5e051fe5-a4fb-484d-ba73-ba73fc426ec6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:59.517341 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5e051fe5-a4fb-484d-ba73-ba73fc426ec6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:59.519349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5e051fe5-a4fb-484d-ba73-ba73fc426ec6 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.178820 Jun 29 11:30:59.519952 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 297/606] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:30:59 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:30:59.659587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-01d69045-40aa-4724-94c1-611f7f5960df tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:30:59.660925 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-01d69045-40aa-4724-94c1-611f7f5960df tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:30:59.668454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01d69045-40aa-4724-94c1-611f7f5960df tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:59.668900 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01d69045-40aa-4724-94c1-611f7f5960df tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:59.669679 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01d69045-40aa-4724-94c1-611f7f5960df tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:30:59.670112 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01d69045-40aa-4724-94c1-611f7f5960df tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:30:59.815224 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-01d69045-40aa-4724-94c1-611f7f5960df tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:30:59.831680 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-01d69045-40aa-4724-94c1-611f7f5960df tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.171775 Jun 29 11:30:59.831680 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 310/607] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:30:59 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:00.087919 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-093878f7-448a-4cc4-90fc-1957ea8aee87 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:00.088682 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-093878f7-448a-4cc4-90fc-1957ea8aee87 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:00.095090 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-093878f7-448a-4cc4-90fc-1957ea8aee87 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:00.095643 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-093878f7-448a-4cc4-90fc-1957ea8aee87 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:00.096534 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-093878f7-448a-4cc4-90fc-1957ea8aee87 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:00.097041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-093878f7-448a-4cc4-90fc-1957ea8aee87 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:00.256778 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-093878f7-448a-4cc4-90fc-1957ea8aee87 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:00.264795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-093878f7-448a-4cc4-90fc-1957ea8aee87 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.180759 Jun 29 11:31:00.265588 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 298/608] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:00 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:00.538458 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-faf562a8-fa1e-47c1-af1f-07bbfafb9d71 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:00.538989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-faf562a8-fa1e-47c1-af1f-07bbfafb9d71 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:00.547529 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-faf562a8-fa1e-47c1-af1f-07bbfafb9d71 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:00.547529 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-faf562a8-fa1e-47c1-af1f-07bbfafb9d71 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:00.547529 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-faf562a8-fa1e-47c1-af1f-07bbfafb9d71 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:00.547529 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-faf562a8-fa1e-47c1-af1f-07bbfafb9d71 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:00.700709 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-faf562a8-fa1e-47c1-af1f-07bbfafb9d71 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:00.711116 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-faf562a8-fa1e-47c1-af1f-07bbfafb9d71 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:00.712750 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-faf562a8-fa1e-47c1-af1f-07bbfafb9d71 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:00.713942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-faf562a8-fa1e-47c1-af1f-07bbfafb9d71 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.179825 Jun 29 11:31:00.714503 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 311/609] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:00 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:00.846803 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-947b4cd1-b366-49b8-a819-0f039d8e0768 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:00.848752 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-947b4cd1-b366-49b8-a819-0f039d8e0768 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:00.857781 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-947b4cd1-b366-49b8-a819-0f039d8e0768 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:00.858737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-947b4cd1-b366-49b8-a819-0f039d8e0768 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:00.859796 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-947b4cd1-b366-49b8-a819-0f039d8e0768 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:00.860472 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-947b4cd1-b366-49b8-a819-0f039d8e0768 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:01.001080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-947b4cd1-b366-49b8-a819-0f039d8e0768 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:01.008727 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-947b4cd1-b366-49b8-a819-0f039d8e0768 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.167839 Jun 29 11:31:01.009296 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 299/610] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:00 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:01.282737 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4c8ec943-f418-4d6a-bf02-73e921fb78ca tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:01.283481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4c8ec943-f418-4d6a-bf02-73e921fb78ca tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:01.291205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c8ec943-f418-4d6a-bf02-73e921fb78ca tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:01.291751 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c8ec943-f418-4d6a-bf02-73e921fb78ca tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:01.292659 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c8ec943-f418-4d6a-bf02-73e921fb78ca tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:01.293095 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c8ec943-f418-4d6a-bf02-73e921fb78ca tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:01.434290 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4c8ec943-f418-4d6a-bf02-73e921fb78ca tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:01.442094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4c8ec943-f418-4d6a-bf02-73e921fb78ca tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.163544 Jun 29 11:31:01.442663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 312/611] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:01 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:01.732315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a7ee3eb4-0ac6-4da7-b8b5-2ceddb8d173f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:01.732912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a7ee3eb4-0ac6-4da7-b8b5-2ceddb8d173f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:01.738900 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7ee3eb4-0ac6-4da7-b8b5-2ceddb8d173f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:01.739340 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7ee3eb4-0ac6-4da7-b8b5-2ceddb8d173f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:01.740177 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7ee3eb4-0ac6-4da7-b8b5-2ceddb8d173f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:01.740602 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7ee3eb4-0ac6-4da7-b8b5-2ceddb8d173f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:01.866719 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a7ee3eb4-0ac6-4da7-b8b5-2ceddb8d173f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:01.875394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a7ee3eb4-0ac6-4da7-b8b5-2ceddb8d173f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:01.877057 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a7ee3eb4-0ac6-4da7-b8b5-2ceddb8d173f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:01.879099 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a7ee3eb4-0ac6-4da7-b8b5-2ceddb8d173f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.150700 Jun 29 11:31:01.879648 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 300/612] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:01 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:02.025983 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-52a809d6-da2d-49b4-8582-3fbb251d5d4d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:02.026552 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-52a809d6-da2d-49b4-8582-3fbb251d5d4d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:02.032935 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52a809d6-da2d-49b4-8582-3fbb251d5d4d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:02.033377 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52a809d6-da2d-49b4-8582-3fbb251d5d4d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:02.034153 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52a809d6-da2d-49b4-8582-3fbb251d5d4d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:02.034584 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52a809d6-da2d-49b4-8582-3fbb251d5d4d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:02.158522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-52a809d6-da2d-49b4-8582-3fbb251d5d4d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:02.165994 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-52a809d6-da2d-49b4-8582-3fbb251d5d4d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.143958 Jun 29 11:31:02.166559 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 313/613] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:02 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:02.458906 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3ded9a9b-5e21-4dca-bae4-729b7499c496 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:02.459512 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3ded9a9b-5e21-4dca-bae4-729b7499c496 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:02.465550 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ded9a9b-5e21-4dca-bae4-729b7499c496 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:02.465993 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ded9a9b-5e21-4dca-bae4-729b7499c496 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:02.466747 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ded9a9b-5e21-4dca-bae4-729b7499c496 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:02.467176 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ded9a9b-5e21-4dca-bae4-729b7499c496 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:02.609309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3ded9a9b-5e21-4dca-bae4-729b7499c496 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:02.618424 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3ded9a9b-5e21-4dca-bae4-729b7499c496 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.163293 Jun 29 11:31:02.618986 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 301/614] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:02 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:02.896999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d3a8feed-f6d7-4a9c-8217-aab4c07adc0d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:02.897599 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d3a8feed-f6d7-4a9c-8217-aab4c07adc0d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:02.903497 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3a8feed-f6d7-4a9c-8217-aab4c07adc0d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:02.903966 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3a8feed-f6d7-4a9c-8217-aab4c07adc0d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:02.904717 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3a8feed-f6d7-4a9c-8217-aab4c07adc0d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:02.905142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3a8feed-f6d7-4a9c-8217-aab4c07adc0d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:02.909641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:31:03.032218 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d3a8feed-f6d7-4a9c-8217-aab4c07adc0d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:03.040987 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d3a8feed-f6d7-4a9c-8217-aab4c07adc0d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:03.042464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d3a8feed-f6d7-4a9c-8217-aab4c07adc0d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:03.043601 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d3a8feed-f6d7-4a9c-8217-aab4c07adc0d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.151037 Jun 29 11:31:03.044194 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 314/615] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:02 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:03.183149 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e4c0b8f4-463a-4598-bb9c-ce51115d7c6d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:03.183752 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e4c0b8f4-463a-4598-bb9c-ce51115d7c6d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:03.192942 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4c0b8f4-463a-4598-bb9c-ce51115d7c6d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:03.193384 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4c0b8f4-463a-4598-bb9c-ce51115d7c6d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:03.194136 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4c0b8f4-463a-4598-bb9c-ce51115d7c6d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:03.194569 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4c0b8f4-463a-4598-bb9c-ce51115d7c6d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:03.323244 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e4c0b8f4-463a-4598-bb9c-ce51115d7c6d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:03.330590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e4c0b8f4-463a-4598-bb9c-ce51115d7c6d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.151287 Jun 29 11:31:03.331153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 302/616] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:03 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:03.636574 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0df087dc-ac11-47e0-873c-860158a9e0bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:03.637102 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0df087dc-ac11-47e0-873c-860158a9e0bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:03.643097 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0df087dc-ac11-47e0-873c-860158a9e0bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:03.643547 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0df087dc-ac11-47e0-873c-860158a9e0bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:03.644349 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0df087dc-ac11-47e0-873c-860158a9e0bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:03.644792 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0df087dc-ac11-47e0-873c-860158a9e0bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:03.787507 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0df087dc-ac11-47e0-873c-860158a9e0bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:03.800104 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0df087dc-ac11-47e0-873c-860158a9e0bd tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.167408 Jun 29 11:31:03.800683 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 315/617] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:03 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:04.061730 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a0b79105-6cb9-436e-a67b-f555de446aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:04.062331 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a0b79105-6cb9-436e-a67b-f555de446aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:04.068410 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a0b79105-6cb9-436e-a67b-f555de446aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:04.068855 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a0b79105-6cb9-436e-a67b-f555de446aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:04.069604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a0b79105-6cb9-436e-a67b-f555de446aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:04.070034 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a0b79105-6cb9-436e-a67b-f555de446aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:04.200674 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a0b79105-6cb9-436e-a67b-f555de446aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:04.209508 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a0b79105-6cb9-436e-a67b-f555de446aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:04.211017 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a0b79105-6cb9-436e-a67b-f555de446aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:04.212191 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a0b79105-6cb9-436e-a67b-f555de446aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.154295 Jun 29 11:31:04.212742 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 303/618] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:04 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:31:04.347686 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3f698997-e23c-4a33-b7ce-c26c57e31792 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:04.348950 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3f698997-e23c-4a33-b7ce-c26c57e31792 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:04.355618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f698997-e23c-4a33-b7ce-c26c57e31792 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:04.356109 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f698997-e23c-4a33-b7ce-c26c57e31792 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:04.358380 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f698997-e23c-4a33-b7ce-c26c57e31792 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:04.358380 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f698997-e23c-4a33-b7ce-c26c57e31792 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:04.486896 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3f698997-e23c-4a33-b7ce-c26c57e31792 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:04.494347 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3f698997-e23c-4a33-b7ce-c26c57e31792 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1676 microversion: 2.1 time: 0.150570 Jun 29 11:31:04.494903 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 316/619] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:04 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:04.818063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3ec0e8da-b4e1-495a-96ec-de46d09be115 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:04.818666 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3ec0e8da-b4e1-495a-96ec-de46d09be115 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:04.824642 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ec0e8da-b4e1-495a-96ec-de46d09be115 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:04.825083 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ec0e8da-b4e1-495a-96ec-de46d09be115 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:04.825837 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ec0e8da-b4e1-495a-96ec-de46d09be115 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:04.826268 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ec0e8da-b4e1-495a-96ec-de46d09be115 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:04.966220 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3ec0e8da-b4e1-495a-96ec-de46d09be115 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:04.974090 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3ec0e8da-b4e1-495a-96ec-de46d09be115 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.160422 Jun 29 11:31:04.974657 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 304/620] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:04 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:05.230777 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1794ce9-714b-4446-be90-d69edfef55c4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:05.231409 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c1794ce9-714b-4446-be90-d69edfef55c4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:05.237349 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1794ce9-714b-4446-be90-d69edfef55c4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:05.237786 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1794ce9-714b-4446-be90-d69edfef55c4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:05.238539 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1794ce9-714b-4446-be90-d69edfef55c4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:05.239480 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1794ce9-714b-4446-be90-d69edfef55c4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:05.367188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1794ce9-714b-4446-be90-d69edfef55c4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:05.375366 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1794ce9-714b-4446-be90-d69edfef55c4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:05.376875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1794ce9-714b-4446-be90-d69edfef55c4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:05.378011 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c1794ce9-714b-4446-be90-d69edfef55c4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.151172 Jun 29 11:31:05.378562 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 317/621] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:05 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:05.510602 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-98e908b6-0fec-4c0f-847d-6ddd186721b2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:05.511145 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-98e908b6-0fec-4c0f-847d-6ddd186721b2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:05.513730 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=70 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:31:05.518423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98e908b6-0fec-4c0f-847d-6ddd186721b2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:05.518893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98e908b6-0fec-4c0f-847d-6ddd186721b2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:05.519673 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98e908b6-0fec-4c0f-847d-6ddd186721b2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:05.520166 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98e908b6-0fec-4c0f-847d-6ddd186721b2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:05.645954 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-98e908b6-0fec-4c0f-847d-6ddd186721b2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:05.653312 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-98e908b6-0fec-4c0f-847d-6ddd186721b2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1653 microversion: 2.1 time: 0.146615 Jun 29 11:31:05.653881 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 305/622] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:05 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1653 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:05.670216 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e1ff6a14-fa46-4620-ad5b-4c46d641b139 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:31:05.676205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1ff6a14-fa46-4620-ad5b-4c46d641b139 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:05.676648 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1ff6a14-fa46-4620-ad5b-4c46d641b139 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:05.699022 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e1ff6a14-fa46-4620-ad5b-4c46d641b139 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Going to try to start instance {{(pid=117920) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 29 11:31:05.853894 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e1ff6a14-fa46-4620-ad5b-4c46d641b139 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "POST /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/action" status: 202 len: 0 microversion: 2.1 time: 0.187280 Jun 29 11:31:05.854417 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 318/623] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:31:05 2022] POST /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:31:05.862612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8af49194-f0fa-4bd1-adb0-0d7be353f1d8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:05.863231 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8af49194-f0fa-4bd1-adb0-0d7be353f1d8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:05.869264 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8af49194-f0fa-4bd1-adb0-0d7be353f1d8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:05.869697 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8af49194-f0fa-4bd1-adb0-0d7be353f1d8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:05.870452 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8af49194-f0fa-4bd1-adb0-0d7be353f1d8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:05.870904 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8af49194-f0fa-4bd1-adb0-0d7be353f1d8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:05.990997 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c4ace2b3-450f-4410-bc4c-d968c5eee486 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:05.992079 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c4ace2b3-450f-4410-bc4c-d968c5eee486 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:05.998291 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4ace2b3-450f-4410-bc4c-d968c5eee486 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:05.998762 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4ace2b3-450f-4410-bc4c-d968c5eee486 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:05.999525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4ace2b3-450f-4410-bc4c-d968c5eee486 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:05.999991 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4ace2b3-450f-4410-bc4c-d968c5eee486 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:06.013878 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8af49194-f0fa-4bd1-adb0-0d7be353f1d8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:06.022943 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8af49194-f0fa-4bd1-adb0-0d7be353f1d8 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1662 microversion: 2.1 time: 0.164204 Jun 29 11:31:06.027885 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 306/624] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:05 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1662 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:06.151039 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c4ace2b3-450f-4410-bc4c-d968c5eee486 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:06.158882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c4ace2b3-450f-4410-bc4c-d968c5eee486 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1754 microversion: 2.1 time: 0.172143 Jun 29 11:31:06.159461 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 319/625] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:05 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:31:06.396146 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7289df8e-edcf-45de-b55c-08e209e2e99d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:06.396743 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7289df8e-edcf-45de-b55c-08e209e2e99d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:06.402729 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7289df8e-edcf-45de-b55c-08e209e2e99d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:06.403110 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7289df8e-edcf-45de-b55c-08e209e2e99d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:06.403905 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7289df8e-edcf-45de-b55c-08e209e2e99d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:06.404331 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7289df8e-edcf-45de-b55c-08e209e2e99d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:06.540503 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7289df8e-edcf-45de-b55c-08e209e2e99d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:06.549047 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7289df8e-edcf-45de-b55c-08e209e2e99d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:06.550631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7289df8e-edcf-45de-b55c-08e209e2e99d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:06.552423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7289df8e-edcf-45de-b55c-08e209e2e99d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.160124 Jun 29 11:31:06.556421 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 307/626] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:06 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:07.041204 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6fd245cb-f3e8-47eb-b2e5-9b32b2594180 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:07.041745 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6fd245cb-f3e8-47eb-b2e5-9b32b2594180 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:07.048060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6fd245cb-f3e8-47eb-b2e5-9b32b2594180 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:07.048512 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6fd245cb-f3e8-47eb-b2e5-9b32b2594180 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:07.049272 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6fd245cb-f3e8-47eb-b2e5-9b32b2594180 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:07.049707 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6fd245cb-f3e8-47eb-b2e5-9b32b2594180 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:07.175765 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f7652364-5470-4283-95f0-25f2392a0903 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:07.176398 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f7652364-5470-4283-95f0-25f2392a0903 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:07.181792 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6fd245cb-f3e8-47eb-b2e5-9b32b2594180 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:07.182505 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7652364-5470-4283-95f0-25f2392a0903 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:07.182953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7652364-5470-4283-95f0-25f2392a0903 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:07.183715 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7652364-5470-4283-95f0-25f2392a0903 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:07.184175 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7652364-5470-4283-95f0-25f2392a0903 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:07.189135 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6fd245cb-f3e8-47eb-b2e5-9b32b2594180 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1662 microversion: 2.1 time: 0.151870 Jun 29 11:31:07.189901 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 320/627] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:07 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:31:07.202998 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:31:07.325050 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f7652364-5470-4283-95f0-25f2392a0903 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:07.333576 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f7652364-5470-4283-95f0-25f2392a0903 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1757 microversion: 2.1 time: 0.161623 Jun 29 11:31:07.334146 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 308/628] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:07 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:31:07.570988 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a47b99e1-8490-4812-a75e-4269c7650c27 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:07.571609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a47b99e1-8490-4812-a75e-4269c7650c27 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:07.577655 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a47b99e1-8490-4812-a75e-4269c7650c27 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:07.578036 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a47b99e1-8490-4812-a75e-4269c7650c27 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:07.578783 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a47b99e1-8490-4812-a75e-4269c7650c27 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:07.579216 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a47b99e1-8490-4812-a75e-4269c7650c27 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:07.716339 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a47b99e1-8490-4812-a75e-4269c7650c27 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:07.725553 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a47b99e1-8490-4812-a75e-4269c7650c27 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:07.727040 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a47b99e1-8490-4812-a75e-4269c7650c27 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:07.728223 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a47b99e1-8490-4812-a75e-4269c7650c27 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.161634 Jun 29 11:31:07.729403 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 321/629] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:07 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:31:08.205380 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-72770e76-dc0c-4bc7-aa8c-6aca226d3e5e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:08.205996 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-72770e76-dc0c-4bc7-aa8c-6aca226d3e5e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:08.212465 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-72770e76-dc0c-4bc7-aa8c-6aca226d3e5e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:08.212918 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-72770e76-dc0c-4bc7-aa8c-6aca226d3e5e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:08.213676 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-72770e76-dc0c-4bc7-aa8c-6aca226d3e5e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:08.214112 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-72770e76-dc0c-4bc7-aa8c-6aca226d3e5e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:08.339374 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-72770e76-dc0c-4bc7-aa8c-6aca226d3e5e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:08.346786 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-72770e76-dc0c-4bc7-aa8c-6aca226d3e5e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1666 microversion: 2.1 time: 0.145236 Jun 29 11:31:08.347354 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 309/630] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:08 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1666 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:08.745691 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7bd0b9f0-e28b-494a-99c0-a0c5f208264c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:08.746300 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7bd0b9f0-e28b-494a-99c0-a0c5f208264c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:08.752766 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7bd0b9f0-e28b-494a-99c0-a0c5f208264c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:08.753213 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7bd0b9f0-e28b-494a-99c0-a0c5f208264c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:08.753962 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7bd0b9f0-e28b-494a-99c0-a0c5f208264c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:08.755050 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7bd0b9f0-e28b-494a-99c0-a0c5f208264c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:08.882580 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7bd0b9f0-e28b-494a-99c0-a0c5f208264c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:08.890727 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7bd0b9f0-e28b-494a-99c0-a0c5f208264c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:08.892249 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7bd0b9f0-e28b-494a-99c0-a0c5f208264c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:08.893410 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7bd0b9f0-e28b-494a-99c0-a0c5f208264c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.151574 Jun 29 11:31:08.893983 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 322/631] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:08 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:09.910789 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-106e2b0f-3efb-448e-8d00-544b482840b5 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:09.912018 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-106e2b0f-3efb-448e-8d00-544b482840b5 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:09.918608 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-106e2b0f-3efb-448e-8d00-544b482840b5 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:09.919056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-106e2b0f-3efb-448e-8d00-544b482840b5 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:09.919842 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-106e2b0f-3efb-448e-8d00-544b482840b5 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:09.920282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-106e2b0f-3efb-448e-8d00-544b482840b5 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:10.046317 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-106e2b0f-3efb-448e-8d00-544b482840b5 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:10.055351 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-106e2b0f-3efb-448e-8d00-544b482840b5 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:10.056894 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-106e2b0f-3efb-448e-8d00-544b482840b5 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:10.058054 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-106e2b0f-3efb-448e-8d00-544b482840b5 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.151211 Jun 29 11:31:10.058610 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 310/632] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:09 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:11.076728 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-22472163-9f99-4daa-afe8-9f282eb664df tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:11.077333 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-22472163-9f99-4daa-afe8-9f282eb664df tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:11.084396 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22472163-9f99-4daa-afe8-9f282eb664df tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:11.084837 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22472163-9f99-4daa-afe8-9f282eb664df tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:11.085581 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22472163-9f99-4daa-afe8-9f282eb664df tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:11.086005 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22472163-9f99-4daa-afe8-9f282eb664df tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:11.218789 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-22472163-9f99-4daa-afe8-9f282eb664df tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:11.228007 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-22472163-9f99-4daa-afe8-9f282eb664df tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:11.229514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-22472163-9f99-4daa-afe8-9f282eb664df tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:11.230661 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-22472163-9f99-4daa-afe8-9f282eb664df tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.157953 Jun 29 11:31:11.231211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 323/633] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:11 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:12.248619 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f957efb4-8e87-4ce9-8e9e-31c77f098820 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:12.249229 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f957efb4-8e87-4ce9-8e9e-31c77f098820 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:12.256425 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f957efb4-8e87-4ce9-8e9e-31c77f098820 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:12.256872 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f957efb4-8e87-4ce9-8e9e-31c77f098820 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:12.257665 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f957efb4-8e87-4ce9-8e9e-31c77f098820 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:12.258101 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f957efb4-8e87-4ce9-8e9e-31c77f098820 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:12.601949 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f957efb4-8e87-4ce9-8e9e-31c77f098820 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:12.610366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f957efb4-8e87-4ce9-8e9e-31c77f098820 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:12.611893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f957efb4-8e87-4ce9-8e9e-31c77f098820 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:12.613079 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f957efb4-8e87-4ce9-8e9e-31c77f098820 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.368345 Jun 29 11:31:12.613657 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 311/634] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:12 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:13.632088 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6a8687dc-25df-4d01-90b8-d82394b2f5a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:13.632624 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6a8687dc-25df-4d01-90b8-d82394b2f5a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:13.639167 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a8687dc-25df-4d01-90b8-d82394b2f5a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:13.639672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a8687dc-25df-4d01-90b8-d82394b2f5a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:13.640457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a8687dc-25df-4d01-90b8-d82394b2f5a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:13.640884 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a8687dc-25df-4d01-90b8-d82394b2f5a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:13.767011 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6a8687dc-25df-4d01-90b8-d82394b2f5a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:13.775718 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6a8687dc-25df-4d01-90b8-d82394b2f5a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:13.777267 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6a8687dc-25df-4d01-90b8-d82394b2f5a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:13.778454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6a8687dc-25df-4d01-90b8-d82394b2f5a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.150521 Jun 29 11:31:13.779049 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 324/635] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:13 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:31:14.797073 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6d8c89ae-2d79-4842-870a-ed6783906f49 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:14.797703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6d8c89ae-2d79-4842-870a-ed6783906f49 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:14.805727 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d8c89ae-2d79-4842-870a-ed6783906f49 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:14.806169 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d8c89ae-2d79-4842-870a-ed6783906f49 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:14.806927 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d8c89ae-2d79-4842-870a-ed6783906f49 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:14.807358 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d8c89ae-2d79-4842-870a-ed6783906f49 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:14.935412 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6d8c89ae-2d79-4842-870a-ed6783906f49 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:14.944343 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6d8c89ae-2d79-4842-870a-ed6783906f49 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:14.945839 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6d8c89ae-2d79-4842-870a-ed6783906f49 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:14.946983 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6d8c89ae-2d79-4842-870a-ed6783906f49 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.153790 Jun 29 11:31:14.947534 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 312/636] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:14 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:15.258147 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-ec9a016a-1e56-4a23-9271-dbca822625f0 req-28f7a737-2ecf-49b7-8937-ff906ff55877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde34fdf-bfe6-48a4-9b9e-95ff879ffa70", "name": "network-vif-plugged", "status": "completed", "tag": "dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:31:15.267023 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ec9a016a-1e56-4a23-9271-dbca822625f0 req-28f7a737-2ecf-49b7-8937-ff906ff55877 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:15.267465 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ec9a016a-1e56-4a23-9271-dbca822625f0 req-28f7a737-2ecf-49b7-8937-ff906ff55877 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:15.278044 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-ec9a016a-1e56-4a23-9271-dbca822625f0 req-28f7a737-2ecf-49b7-8937-ff906ff55877 service nova] Creating event network-vif-plugged:dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48 for instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 on hv-cinder-84733 Jun 29 11:31:15.283004 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-ec9a016a-1e56-4a23-9271-dbca822625f0 req-28f7a737-2ecf-49b7-8937-ff906ff55877 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028571 Jun 29 11:31:15.283644 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 325/637] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:31:15.965468 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8b480d44-e2db-48dc-bf29-d8d4bc864e6d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:15.966064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8b480d44-e2db-48dc-bf29-d8d4bc864e6d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:15.972426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b480d44-e2db-48dc-bf29-d8d4bc864e6d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:15.972909 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b480d44-e2db-48dc-bf29-d8d4bc864e6d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:15.973612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b480d44-e2db-48dc-bf29-d8d4bc864e6d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:15.974038 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8b480d44-e2db-48dc-bf29-d8d4bc864e6d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:16.135475 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8b480d44-e2db-48dc-bf29-d8d4bc864e6d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:16.143776 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8b480d44-e2db-48dc-bf29-d8d4bc864e6d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:16.145299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8b480d44-e2db-48dc-bf29-d8d4bc864e6d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:16.146494 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8b480d44-e2db-48dc-bf29-d8d4bc864e6d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.184880 Jun 29 11:31:16.147053 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 313/638] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:15 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:17.166141 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-489f6d6a-07a7-434a-b96a-442f03014476 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:17.166765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-489f6d6a-07a7-434a-b96a-442f03014476 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:17.172878 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-489f6d6a-07a7-434a-b96a-442f03014476 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:17.173322 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-489f6d6a-07a7-434a-b96a-442f03014476 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:17.174072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-489f6d6a-07a7-434a-b96a-442f03014476 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:17.174511 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-489f6d6a-07a7-434a-b96a-442f03014476 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:17.301284 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-489f6d6a-07a7-434a-b96a-442f03014476 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:17.309558 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-489f6d6a-07a7-434a-b96a-442f03014476 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:17.311057 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-489f6d6a-07a7-434a-b96a-442f03014476 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:17.312217 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-489f6d6a-07a7-434a-b96a-442f03014476 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.151526 Jun 29 11:31:17.312772 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 326/639] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:17 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:18.330233 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-23178308-d5c2-4abd-968f-9b3deda9af54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:18.330830 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-23178308-d5c2-4abd-968f-9b3deda9af54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:18.338022 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23178308-d5c2-4abd-968f-9b3deda9af54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:18.338534 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23178308-d5c2-4abd-968f-9b3deda9af54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:18.339209 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23178308-d5c2-4abd-968f-9b3deda9af54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:18.339634 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23178308-d5c2-4abd-968f-9b3deda9af54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:18.471766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-23178308-d5c2-4abd-968f-9b3deda9af54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:18.482389 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-23178308-d5c2-4abd-968f-9b3deda9af54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:18.482389 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-23178308-d5c2-4abd-968f-9b3deda9af54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:18.483079 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-23178308-d5c2-4abd-968f-9b3deda9af54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.156699 Jun 29 11:31:18.483636 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 314/640] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:18 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:19.501063 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f287d4ff-1ec8-428e-b8b1-0065b0f89984 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:19.501650 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f287d4ff-1ec8-428e-b8b1-0065b0f89984 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:19.508683 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f287d4ff-1ec8-428e-b8b1-0065b0f89984 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:19.509137 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f287d4ff-1ec8-428e-b8b1-0065b0f89984 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:19.509902 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f287d4ff-1ec8-428e-b8b1-0065b0f89984 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:19.510344 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f287d4ff-1ec8-428e-b8b1-0065b0f89984 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:19.645336 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f287d4ff-1ec8-428e-b8b1-0065b0f89984 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:19.654301 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f287d4ff-1ec8-428e-b8b1-0065b0f89984 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:19.655794 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f287d4ff-1ec8-428e-b8b1-0065b0f89984 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:19.657635 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f287d4ff-1ec8-428e-b8b1-0065b0f89984 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1809 microversion: 2.20 time: 0.159933 Jun 29 11:31:19.657635 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 327/641] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:19 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:20.675170 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dde4c0f4-0f51-49fb-88c1-f5a7480e9ef9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:20.675701 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dde4c0f4-0f51-49fb-88c1-f5a7480e9ef9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:20.682167 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dde4c0f4-0f51-49fb-88c1-f5a7480e9ef9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:20.682610 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dde4c0f4-0f51-49fb-88c1-f5a7480e9ef9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:20.683364 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dde4c0f4-0f51-49fb-88c1-f5a7480e9ef9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:20.683795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dde4c0f4-0f51-49fb-88c1-f5a7480e9ef9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:20.816151 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dde4c0f4-0f51-49fb-88c1-f5a7480e9ef9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:20.824583 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dde4c0f4-0f51-49fb-88c1-f5a7480e9ef9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:20.826082 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dde4c0f4-0f51-49fb-88c1-f5a7480e9ef9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:20.827215 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dde4c0f4-0f51-49fb-88c1-f5a7480e9ef9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1796 microversion: 2.20 time: 0.156163 Jun 29 11:31:20.827774 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 315/642] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:31:20 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:31:27.551760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:31:27.552292 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Wed Jun 29 11:31:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:31:36.447984 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0a13f486-950b-459e-ae50-97095ad3ff95 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:36.448594 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0a13f486-950b-459e-ae50-97095ad3ff95 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:36.450486 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=45 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:31:36.451128 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:31:36.455806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a13f486-950b-459e-ae50-97095ad3ff95 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:36.456283 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a13f486-950b-459e-ae50-97095ad3ff95 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:36.457039 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a13f486-950b-459e-ae50-97095ad3ff95 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:36.457473 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a13f486-950b-459e-ae50-97095ad3ff95 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:36.580994 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-0a13f486-950b-459e-ae50-97095ad3ff95 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lazy-loading 'services' on Instance uuid 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:31:36.815438 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0a13f486-950b-459e-ae50-97095ad3ff95 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments/f455d98c-7cb1-4e91-b14c-aa41db2bdbac" status: 202 len: 0 microversion: 2.1 time: 0.371243 Jun 29 11:31:36.815990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 328/643] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jun 29 11:31:36 2022] DELETE /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments/f455d98c-7cb1-4e91-b14c-aa41db2bdbac => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:31:36.824837 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6d47d5f4-a1c0-463b-8f65-f841521874b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:36.825808 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6d47d5f4-a1c0-463b-8f65-f841521874b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:36.828420 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=21 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:31:36.829084 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=44 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:31:36.833910 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d47d5f4-a1c0-463b-8f65-f841521874b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:36.834358 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d47d5f4-a1c0-463b-8f65-f841521874b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:36.835119 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d47d5f4-a1c0-463b-8f65-f841521874b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:36.835548 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d47d5f4-a1c0-463b-8f65-f841521874b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:36.864978 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6d47d5f4-a1c0-463b-8f65-f841521874b7 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044680 Jun 29 11:31:36.865518 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 316/644] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:31:36 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:31:37.879154 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4e753f5-990f-4444-bc3e-6aec0b4083e0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:37.880190 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d4e753f5-990f-4444-bc3e-6aec0b4083e0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:37.886841 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4e753f5-990f-4444-bc3e-6aec0b4083e0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:37.887281 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4e753f5-990f-4444-bc3e-6aec0b4083e0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:37.888058 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4e753f5-990f-4444-bc3e-6aec0b4083e0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:37.888484 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4e753f5-990f-4444-bc3e-6aec0b4083e0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:37.917267 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d4e753f5-990f-4444-bc3e-6aec0b4083e0 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042899 Jun 29 11:31:37.918008 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 329/645] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:31:37 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:31:38.928244 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-13b3485a-8c44-4a1b-8ae6-9896b253ebfd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:38.929202 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-13b3485a-8c44-4a1b-8ae6-9896b253ebfd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:38.935753 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13b3485a-8c44-4a1b-8ae6-9896b253ebfd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:38.936228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13b3485a-8c44-4a1b-8ae6-9896b253ebfd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:38.936978 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13b3485a-8c44-4a1b-8ae6-9896b253ebfd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:38.937406 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13b3485a-8c44-4a1b-8ae6-9896b253ebfd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:38.965339 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-13b3485a-8c44-4a1b-8ae6-9896b253ebfd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041504 Jun 29 11:31:38.965889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 317/646] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:31:38 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 11:31:39.038492 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ffd18d86-3c8e-46d3-a70c-97b7f853888b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:39.039017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ffd18d86-3c8e-46d3-a70c-97b7f853888b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:39.049103 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffd18d86-3c8e-46d3-a70c-97b7f853888b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:39.049103 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffd18d86-3c8e-46d3-a70c-97b7f853888b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:39.049103 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffd18d86-3c8e-46d3-a70c-97b7f853888b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:39.049103 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffd18d86-3c8e-46d3-a70c-97b7f853888b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:39.074097 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ffd18d86-3c8e-46d3-a70c-97b7f853888b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:31:39.262012 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ffd18d86-3c8e-46d3-a70c-97b7f853888b tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 204 len: 0 microversion: 2.1 time: 0.227145 Jun 29 11:31:39.262779 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 330/647] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:31:39 2022] DELETE /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:31:39.271187 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-98cb0ed3-a604-4a92-be0a-c07f0ba111a2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:39.271794 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-98cb0ed3-a604-4a92-be0a-c07f0ba111a2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:39.278379 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98cb0ed3-a604-4a92-be0a-c07f0ba111a2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:39.278822 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98cb0ed3-a604-4a92-be0a-c07f0ba111a2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:39.279578 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98cb0ed3-a604-4a92-be0a-c07f0ba111a2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:39.280035 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98cb0ed3-a604-4a92-be0a-c07f0ba111a2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:39.418691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-98cb0ed3-a604-4a92-be0a-c07f0ba111a2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:39.426040 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-98cb0ed3-a604-4a92-be0a-c07f0ba111a2 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1690 microversion: 2.1 time: 0.158772 Jun 29 11:31:39.426593 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 318/648] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:39 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:40.443014 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-42ec3dc5-4ff8-421e-b715-4050f9585d8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:40.443750 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-42ec3dc5-4ff8-421e-b715-4050f9585d8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:40.450184 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42ec3dc5-4ff8-421e-b715-4050f9585d8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:40.450633 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42ec3dc5-4ff8-421e-b715-4050f9585d8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:40.451421 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42ec3dc5-4ff8-421e-b715-4050f9585d8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:40.451877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42ec3dc5-4ff8-421e-b715-4050f9585d8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:40.577957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-42ec3dc5-4ff8-421e-b715-4050f9585d8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:40.585382 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-42ec3dc5-4ff8-421e-b715-4050f9585d8c tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1690 microversion: 2.1 time: 0.146611 Jun 29 11:31:40.585945 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 331/649] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:40 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:41.602931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-89ed459a-d653-4d0e-9695-fd21c538d557 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:41.604059 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-89ed459a-d653-4d0e-9695-fd21c538d557 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:41.610362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89ed459a-d653-4d0e-9695-fd21c538d557 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:41.610797 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89ed459a-d653-4d0e-9695-fd21c538d557 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:41.611544 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89ed459a-d653-4d0e-9695-fd21c538d557 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:41.612016 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89ed459a-d653-4d0e-9695-fd21c538d557 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:41.741150 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-89ed459a-d653-4d0e-9695-fd21c538d557 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:41.749094 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-89ed459a-d653-4d0e-9695-fd21c538d557 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1690 microversion: 2.1 time: 0.150282 Jun 29 11:31:41.749649 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 319/650] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:41 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:42.766438 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7698d6b6-9c7c-4c2d-8369-d6aa0fe7edc6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:42.767055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7698d6b6-9c7c-4c2d-8369-d6aa0fe7edc6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:42.773633 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7698d6b6-9c7c-4c2d-8369-d6aa0fe7edc6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:42.774083 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7698d6b6-9c7c-4c2d-8369-d6aa0fe7edc6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:42.774845 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7698d6b6-9c7c-4c2d-8369-d6aa0fe7edc6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:42.775322 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7698d6b6-9c7c-4c2d-8369-d6aa0fe7edc6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:42.910270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7698d6b6-9c7c-4c2d-8369-d6aa0fe7edc6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:42.917739 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7698d6b6-9c7c-4c2d-8369-d6aa0fe7edc6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1690 microversion: 2.1 time: 0.155174 Jun 29 11:31:42.918305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 332/651] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:42 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:43.935110 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e9bf4ef3-c008-464d-8355-a1a5e316f1e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:43.935813 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e9bf4ef3-c008-464d-8355-a1a5e316f1e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:43.943240 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9bf4ef3-c008-464d-8355-a1a5e316f1e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:43.943940 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9bf4ef3-c008-464d-8355-a1a5e316f1e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:43.944776 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9bf4ef3-c008-464d-8355-a1a5e316f1e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:43.945331 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9bf4ef3-c008-464d-8355-a1a5e316f1e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:44.173501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e9bf4ef3-c008-464d-8355-a1a5e316f1e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:44.180969 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e9bf4ef3-c008-464d-8355-a1a5e316f1e9 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1690 microversion: 2.1 time: 0.250425 Jun 29 11:31:44.181544 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 320/652] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:43 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1690 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:31:44.380887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-2353ae01-966e-4021-9783-fc2b827805ef req-a4d0ff5e-b9a2-4595-b4a9-043da098e1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3fb170-5d34-4fa4-8baa-5e404f52f4f2", "name": "network-vif-deleted", "tag": "5593c143-d87b-466f-b8ca-17159064e710"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:31:44.389745 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2353ae01-966e-4021-9783-fc2b827805ef req-a4d0ff5e-b9a2-4595-b4a9-043da098e1ef service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:44.390281 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2353ae01-966e-4021-9783-fc2b827805ef req-a4d0ff5e-b9a2-4595-b4a9-043da098e1ef service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:44.455256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-2353ae01-966e-4021-9783-fc2b827805ef req-a4d0ff5e-b9a2-4595-b4a9-043da098e1ef service nova] Creating event network-vif-deleted:5593c143-d87b-466f-b8ca-17159064e710 for instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 on hv-cinder-84733 Jun 29 11:31:44.460328 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-2353ae01-966e-4021-9783-fc2b827805ef req-a4d0ff5e-b9a2-4595-b4a9-043da098e1ef service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083108 Jun 29 11:31:44.461209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 333/653] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:31:45.197935 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-855efe07-6a48-4e04-904d-4ec9ad15a5a6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:45.198541 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-855efe07-6a48-4e04-904d-4ec9ad15a5a6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:45.205583 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-855efe07-6a48-4e04-904d-4ec9ad15a5a6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:45.206370 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-855efe07-6a48-4e04-904d-4ec9ad15a5a6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:45.207528 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-855efe07-6a48-4e04-904d-4ec9ad15a5a6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:45.208220 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-855efe07-6a48-4e04-904d-4ec9ad15a5a6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:45.246832 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-855efe07-6a48-4e04-904d-4ec9ad15a5a6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:45.247589 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-855efe07-6a48-4e04-904d-4ec9ad15a5a6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:45.248248 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-855efe07-6a48-4e04-904d-4ec9ad15a5a6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lazy-loading 'fault' on Instance uuid 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:31:45.292420 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-855efe07-6a48-4e04-904d-4ec9ad15a5a6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:45.300957 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-855efe07-6a48-4e04-904d-4ec9ad15a5a6 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 200 len: 1335 microversion: 2.1 time: 0.107638 Jun 29 11:31:45.301862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 321/654] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:45 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:46.323942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-63e68dfa-3eba-4dd8-b193-00651d12bd1e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:46.324641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-63e68dfa-3eba-4dd8-b193-00651d12bd1e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:46.330811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63e68dfa-3eba-4dd8-b193-00651d12bd1e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:46.331255 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63e68dfa-3eba-4dd8-b193-00651d12bd1e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:46.332043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63e68dfa-3eba-4dd8-b193-00651d12bd1e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:46.332483 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63e68dfa-3eba-4dd8-b193-00651d12bd1e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:46.345972 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-63e68dfa-3eba-4dd8-b193-00651d12bd1e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] HTTP exception thrown: Instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 could not be found. Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-63e68dfa-3eba-4dd8-b193-00651d12bd1e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Request method failure captured: Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 HTTP/1.1 Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZ_hdMYJgq85a0ANpS40L4DnIBMc0L0w2VQmyJptv9vz09vZSHBB5QFP-MIu6lCP_6R2lFejZ1fXBaWqeb2npwIbc3ySbmlrb6USsshKBJfEjko0jZsW2Xjk92OrwImioiZjr5m7Rnec6Fs2oG7eh3N0QRHWm0LQ2lzMoWq-s9mREA Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: cbfba915f70342afb8267e34abc24bfe Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:31:46.347587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:31:46.349100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cbfba915f70342afb8267e34abc24bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cbfba915f70342afb8267e34abc24bfe", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbfba915f70342afb8267e34abc24bfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbfba915f70342afb8267e34abc24bfe"}]}] Jun 29 11:31:46.349100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:31:46.349100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: cbfba915f70342afb8267e34abc24bfe Jun 29 11:31:46.349100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:31:46.349100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-21742587-project Jun 29 11:31:46.349100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:31:46.349100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:31:46.349100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 8effcd6f6be64f14b3c8bc71f8866a99 Jun 29 11:31:46.349100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-21742587-project Jun 29 11:31:46.349100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:31:46.349100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 could not be found. Jun 29 11:31:46.349100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '3d3fb170-5d34-4fa4-8baa-5e404f52f4f2'} Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 could not be found. Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:31:46.350142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 could not be found. Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 could not be found. Jun 29 11:31:46.351820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:31:46.353190 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-63e68dfa-3eba-4dd8-b193-00651d12bd1e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Returning 404 to user: Instance 3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:31:46.353190 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-63e68dfa-3eba-4dd8-b193-00651d12bd1e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2" status: 404 len: 111 microversion: 2.1 time: 0.030343 Jun 29 11:31:46.353190 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 334/655] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:46 2022] GET /compute/v2.1/servers/3d3fb170-5d34-4fa4-8baa-5e404f52f4f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:31:46.357688 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a7549a88-3784-40de-ba8c-aa0f78e39143 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '.version_select at 0x7fd0895838b0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:46.429248 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a7549a88-3784-40de-ba8c-aa0f78e39143 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584312159" status: 202 len: 0 microversion: 2.1 time: 0.075206 Jun 29 11:31:46.429833 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 322/656] 10.222.0.44 () {58 vars in 1220 bytes} [Wed Jun 29 11:31:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584312159 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:31:49.718991 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce3efa83-2d3a-495a-91a8-289f63ad3f08 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:49.719516 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce3efa83-2d3a-495a-91a8-289f63ad3f08 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:49.727806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce3efa83-2d3a-495a-91a8-289f63ad3f08 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:49.728287 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce3efa83-2d3a-495a-91a8-289f63ad3f08 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:49.729634 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce3efa83-2d3a-495a-91a8-289f63ad3f08 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:49.730076 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce3efa83-2d3a-495a-91a8-289f63ad3f08 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:49.762437 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce3efa83-2d3a-495a-91a8-289f63ad3f08 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:31:50.044458 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce3efa83-2d3a-495a-91a8-289f63ad3f08 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 204 len: 0 microversion: 2.1 time: 0.328918 Jun 29 11:31:50.045051 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 335/657] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:31:49 2022] DELETE /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:31:50.054071 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9ed0d581-84b8-4bd1-9b6c-d69246ca934e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:50.054704 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9ed0d581-84b8-4bd1-9b6c-d69246ca934e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:50.063046 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9ed0d581-84b8-4bd1-9b6c-d69246ca934e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:50.063489 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9ed0d581-84b8-4bd1-9b6c-d69246ca934e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:50.064300 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9ed0d581-84b8-4bd1-9b6c-d69246ca934e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:50.064759 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9ed0d581-84b8-4bd1-9b6c-d69246ca934e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:50.195844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9ed0d581-84b8-4bd1-9b6c-d69246ca934e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:50.204423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9ed0d581-84b8-4bd1-9b6c-d69246ca934e tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1508 microversion: 2.1 time: 0.155123 Jun 29 11:31:50.205063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 323/658] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:50 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:51.222512 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf426fa6-2688-41d2-a136-9d2ecd9ecabb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:51.223198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf426fa6-2688-41d2-a136-9d2ecd9ecabb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:51.230519 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf426fa6-2688-41d2-a136-9d2ecd9ecabb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:51.230965 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf426fa6-2688-41d2-a136-9d2ecd9ecabb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:51.231715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf426fa6-2688-41d2-a136-9d2ecd9ecabb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:51.232170 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf426fa6-2688-41d2-a136-9d2ecd9ecabb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:51.445524 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cf426fa6-2688-41d2-a136-9d2ecd9ecabb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:51.453518 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf426fa6-2688-41d2-a136-9d2ecd9ecabb tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1508 microversion: 2.1 time: 0.235262 Jun 29 11:31:51.454080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 336/659] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:51 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:51.683383 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-784b61b5-b34b-44d5-9f13-d18e7da033d7 req-f6cd554c-1909-4de8-af7a-9da072894fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02fe76c-c085-47fd-87a6-e650d39f6a4c", "name": "network-vif-deleted", "tag": "8177ac60-ca71-481f-875b-657d98a48d6d"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:31:51.692478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-784b61b5-b34b-44d5-9f13-d18e7da033d7 req-f6cd554c-1909-4de8-af7a-9da072894fd3 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:51.693014 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-784b61b5-b34b-44d5-9f13-d18e7da033d7 req-f6cd554c-1909-4de8-af7a-9da072894fd3 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:51.713890 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-784b61b5-b34b-44d5-9f13-d18e7da033d7 req-f6cd554c-1909-4de8-af7a-9da072894fd3 service nova] Creating event network-vif-deleted:8177ac60-ca71-481f-875b-657d98a48d6d for instance b02fe76c-c085-47fd-87a6-e650d39f6a4c on hv-cinder-84733 Jun 29 11:31:51.719371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-784b61b5-b34b-44d5-9f13-d18e7da033d7 req-f6cd554c-1909-4de8-af7a-9da072894fd3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040668 Jun 29 11:31:51.720479 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 324/660] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:31:52.471000 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-667f6060-0117-43da-a646-9c18aaab5bdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:52.471702 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-667f6060-0117-43da-a646-9c18aaab5bdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:52.478220 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667f6060-0117-43da-a646-9c18aaab5bdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:52.479197 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667f6060-0117-43da-a646-9c18aaab5bdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:52.479978 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667f6060-0117-43da-a646-9c18aaab5bdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:52.480407 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667f6060-0117-43da-a646-9c18aaab5bdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:52.512402 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667f6060-0117-43da-a646-9c18aaab5bdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:52.512832 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667f6060-0117-43da-a646-9c18aaab5bdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:52.513270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-667f6060-0117-43da-a646-9c18aaab5bdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lazy-loading 'fault' on Instance uuid b02fe76c-c085-47fd-87a6-e650d39f6a4c {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:31:52.554360 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-667f6060-0117-43da-a646-9c18aaab5bdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:52.562995 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-667f6060-0117-43da-a646-9c18aaab5bdf tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 200 len: 1312 microversion: 2.1 time: 0.095895 Jun 29 11:31:52.568272 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 337/661] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:52 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:53.580877 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bb8f04ed-07cb-45a0-80cc-773bc4678a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:53.581572 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bb8f04ed-07cb-45a0-80cc-773bc4678a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: b02fe76c-c085-47fd-87a6-e650d39f6a4c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:53.587982 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb8f04ed-07cb-45a0-80cc-773bc4678a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:53.588453 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb8f04ed-07cb-45a0-80cc-773bc4678a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:53.589246 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb8f04ed-07cb-45a0-80cc-773bc4678a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:53.589679 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb8f04ed-07cb-45a0-80cc-773bc4678a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:53.603225 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-bb8f04ed-07cb-45a0-80cc-773bc4678a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] HTTP exception thrown: Instance b02fe76c-c085-47fd-87a6-e650d39f6a4c could not be found. Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bb8f04ed-07cb-45a0-80cc-773bc4678a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Request method failure captured: Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c HTTP/1.1 Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDZ_hdMYJgq85a0ANpS40L4DnIBMc0L0w2VQmyJptv9vz09vZSHBB5QFP-MIu6lCP_6R2lFejZ1fXBaWqeb2npwIbc3ySbmlrb6USsshKBJfEjko0jZsW2Xjk92OrwImioiZjr5m7Rnec6Fs2oG7eh3N0QRHWm0LQ2lzMoWq-s9mREA Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: cbfba915f70342afb8267e34abc24bfe Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:31:53.605538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:31:53.609417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cbfba915f70342afb8267e34abc24bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cbfba915f70342afb8267e34abc24bfe", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbfba915f70342afb8267e34abc24bfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbfba915f70342afb8267e34abc24bfe"}]}] Jun 29 11:31:53.609417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:31:53.609417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: cbfba915f70342afb8267e34abc24bfe Jun 29 11:31:53.609417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:31:53.609417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-ServerRescueNegativeTestJSON-21742587-project Jun 29 11:31:53.609417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:31:53.609417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:31:53.609417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 8effcd6f6be64f14b3c8bc71f8866a99 Jun 29 11:31:53.609417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-ServerRescueNegativeTestJSON-21742587-project Jun 29 11:31:53.609417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:31:53.609417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance b02fe76c-c085-47fd-87a6-e650d39f6a4c could not be found. Jun 29 11:31:53.609417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': 'b02fe76c-c085-47fd-87a6-e650d39f6a4c'} Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b02fe76c-c085-47fd-87a6-e650d39f6a4c could not be found. Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:31:53.610309 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b02fe76c-c085-47fd-87a6-e650d39f6a4c could not be found. Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b02fe76c-c085-47fd-87a6-e650d39f6a4c could not be found. Jun 29 11:31:53.611738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:31:53.613172 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bb8f04ed-07cb-45a0-80cc-773bc4678a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Returning 404 to user: Instance b02fe76c-c085-47fd-87a6-e650d39f6a4c could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:31:53.613172 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bb8f04ed-07cb-45a0-80cc-773bc4678a0f tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c" status: 404 len: 111 microversion: 2.1 time: 0.030200 Jun 29 11:31:53.613172 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 325/662] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:53 2022] GET /compute/v2.1/servers/b02fe76c-c085-47fd-87a6-e650d39f6a4c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:31:53.614659 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-615b9c95-0452-42d7-98a9-771579953dcd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:53.615178 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-615b9c95-0452-42d7-98a9-771579953dcd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:53.621873 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-615b9c95-0452-42d7-98a9-771579953dcd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:53.622315 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-615b9c95-0452-42d7-98a9-771579953dcd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:53.623061 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-615b9c95-0452-42d7-98a9-771579953dcd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:53.623490 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-615b9c95-0452-42d7-98a9-771579953dcd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:53.648160 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-615b9c95-0452-42d7-98a9-771579953dcd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:31:53.924773 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-615b9c95-0452-42d7-98a9-771579953dcd tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 204 len: 0 microversion: 2.1 time: 0.313643 Jun 29 11:31:53.925371 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 338/663] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:31:53 2022] DELETE /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 11:31:53.934014 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-10ff458a-65a8-4f64-a7f8-7360b47b4c3d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:53.934625 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-10ff458a-65a8-4f64-a7f8-7360b47b4c3d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:53.940805 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10ff458a-65a8-4f64-a7f8-7360b47b4c3d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:53.941255 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10ff458a-65a8-4f64-a7f8-7360b47b4c3d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:53.942008 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10ff458a-65a8-4f64-a7f8-7360b47b4c3d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:53.942444 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10ff458a-65a8-4f64-a7f8-7360b47b4c3d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:54.078255 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-10ff458a-65a8-4f64-a7f8-7360b47b4c3d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:54.085742 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-10ff458a-65a8-4f64-a7f8-7360b47b4c3d tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.156386 Jun 29 11:31:54.086294 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 326/664] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:53 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:55.102664 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b28c12a7-2663-4d6f-93de-3cde87c4ea54 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:55.103295 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b28c12a7-2663-4d6f-93de-3cde87c4ea54 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:55.109760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b28c12a7-2663-4d6f-93de-3cde87c4ea54 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:55.110207 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b28c12a7-2663-4d6f-93de-3cde87c4ea54 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:55.110961 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b28c12a7-2663-4d6f-93de-3cde87c4ea54 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:55.111395 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b28c12a7-2663-4d6f-93de-3cde87c4ea54 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:55.239872 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b28c12a7-2663-4d6f-93de-3cde87c4ea54 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:55.243322 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:31:55.248362 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b28c12a7-2663-4d6f-93de-3cde87c4ea54 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.150032 Jun 29 11:31:55.248761 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 339/665] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:55 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:55.674260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f6784386-cb46-40f5-a01f-532ba9daaca6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:55.674808 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f6784386-cb46-40f5-a01f-532ba9daaca6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:55.681147 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6784386-cb46-40f5-a01f-532ba9daaca6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:55.681590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6784386-cb46-40f5-a01f-532ba9daaca6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:55.682341 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6784386-cb46-40f5-a01f-532ba9daaca6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:55.682772 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6784386-cb46-40f5-a01f-532ba9daaca6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:55.708520 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f6784386-cb46-40f5-a01f-532ba9daaca6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:31:55.947596 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f6784386-cb46-40f5-a01f-532ba9daaca6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "DELETE /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 204 len: 0 microversion: 2.1 time: 0.276960 Jun 29 11:31:55.948288 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 327/666] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:31:55 2022] DELETE /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:31:55.956863 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9778a7ea-ec5b-4dd9-adfd-e56faef54b12 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:55.960561 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9778a7ea-ec5b-4dd9-adfd-e56faef54b12 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:55.964193 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9778a7ea-ec5b-4dd9-adfd-e56faef54b12 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:55.964634 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9778a7ea-ec5b-4dd9-adfd-e56faef54b12 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:55.965381 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9778a7ea-ec5b-4dd9-adfd-e56faef54b12 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:55.965807 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9778a7ea-ec5b-4dd9-adfd-e56faef54b12 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:56.106895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9778a7ea-ec5b-4dd9-adfd-e56faef54b12 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:56.114608 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9778a7ea-ec5b-4dd9-adfd-e56faef54b12 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1578 microversion: 2.1 time: 0.161778 Jun 29 11:31:56.115170 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 340/667] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:55 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:56.265577 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eb8c9179-c1a2-42dc-b2af-924c544965c8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:56.266275 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eb8c9179-c1a2-42dc-b2af-924c544965c8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:56.272296 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb8c9179-c1a2-42dc-b2af-924c544965c8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:56.272744 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb8c9179-c1a2-42dc-b2af-924c544965c8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:56.273507 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb8c9179-c1a2-42dc-b2af-924c544965c8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:56.274034 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb8c9179-c1a2-42dc-b2af-924c544965c8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:56.403750 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eb8c9179-c1a2-42dc-b2af-924c544965c8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:56.411307 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eb8c9179-c1a2-42dc-b2af-924c544965c8 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.149971 Jun 29 11:31:56.411893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 328/668] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:56 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:57.187037 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-29931231-5135-4c5c-8d6f-f5f8aed97d7f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:57.187718 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-29931231-5135-4c5c-8d6f-f5f8aed97d7f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:57.194148 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29931231-5135-4c5c-8d6f-f5f8aed97d7f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:57.194594 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29931231-5135-4c5c-8d6f-f5f8aed97d7f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:57.195338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29931231-5135-4c5c-8d6f-f5f8aed97d7f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:57.195766 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29931231-5135-4c5c-8d6f-f5f8aed97d7f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:57.324653 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-29931231-5135-4c5c-8d6f-f5f8aed97d7f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:57.332075 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-29931231-5135-4c5c-8d6f-f5f8aed97d7f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1578 microversion: 2.1 time: 0.148816 Jun 29 11:31:57.338747 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 341/669] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:57 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:57.427800 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0781d3ab-c3c5-494f-b961-c06213da917a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:57.428428 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0781d3ab-c3c5-494f-b961-c06213da917a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:57.435381 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0781d3ab-c3c5-494f-b961-c06213da917a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:57.435822 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0781d3ab-c3c5-494f-b961-c06213da917a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:57.436597 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0781d3ab-c3c5-494f-b961-c06213da917a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:57.437030 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0781d3ab-c3c5-494f-b961-c06213da917a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:57.564709 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0781d3ab-c3c5-494f-b961-c06213da917a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:57.571954 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0781d3ab-c3c5-494f-b961-c06213da917a tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1522 microversion: 2.1 time: 0.147957 Jun 29 11:31:57.572511 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 329/670] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:57 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:58.352860 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-90bdc588-5dd0-40b0-8100-10627fbb9c7e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:58.353466 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-90bdc588-5dd0-40b0-8100-10627fbb9c7e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:58.370270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90bdc588-5dd0-40b0-8100-10627fbb9c7e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:58.370270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90bdc588-5dd0-40b0-8100-10627fbb9c7e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:58.370270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90bdc588-5dd0-40b0-8100-10627fbb9c7e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:58.370270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90bdc588-5dd0-40b0-8100-10627fbb9c7e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:58.387331 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-ec7524b4-04ae-4647-aa05-b842b7cd8a85 req-2b69cb8b-3ada-42f4-b32f-0f742d2ee1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9821f7d-2d75-40ae-b7a1-81bd38b28a26", "name": "network-vif-deleted", "tag": "e421f408-a03a-4b88-9f92-6c06ba04c28d"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:31:58.397658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ec7524b4-04ae-4647-aa05-b842b7cd8a85 req-2b69cb8b-3ada-42f4-b32f-0f742d2ee1b1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:58.398099 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ec7524b4-04ae-4647-aa05-b842b7cd8a85 req-2b69cb8b-3ada-42f4-b32f-0f742d2ee1b1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:58.414511 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-ec7524b4-04ae-4647-aa05-b842b7cd8a85 req-2b69cb8b-3ada-42f4-b32f-0f742d2ee1b1 service nova] Creating event network-vif-deleted:e421f408-a03a-4b88-9f92-6c06ba04c28d for instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 on hv-cinder-84733 Jun 29 11:31:58.420416 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-ec7524b4-04ae-4647-aa05-b842b7cd8a85 req-2b69cb8b-3ada-42f4-b32f-0f742d2ee1b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046629 Jun 29 11:31:58.421763 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 330/671] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:31:58.519815 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-90bdc588-5dd0-40b0-8100-10627fbb9c7e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:58.529874 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-90bdc588-5dd0-40b0-8100-10627fbb9c7e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1578 microversion: 2.1 time: 0.182978 Jun 29 11:31:58.533217 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 342/672] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:58 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:58.590626 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7c7a757a-d974-4ab6-873e-f7e432c21454 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:58.591268 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7c7a757a-d974-4ab6-873e-f7e432c21454 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:58.597601 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7c7a757a-d974-4ab6-873e-f7e432c21454 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:58.597986 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7c7a757a-d974-4ab6-873e-f7e432c21454 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:58.598767 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7c7a757a-d974-4ab6-873e-f7e432c21454 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:58.599193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7c7a757a-d974-4ab6-873e-f7e432c21454 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:58.668620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7c7a757a-d974-4ab6-873e-f7e432c21454 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8effcd6f6be64f14b3c8bc71f8866a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba915f70342afb8267e34abc24bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:58.676202 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7c7a757a-d974-4ab6-873e-f7e432c21454 tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 200 len: 1307 microversion: 2.1 time: 0.090832 Jun 29 11:31:58.676818 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 331/673] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:58 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:59.071222 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-fde081c8-ec9e-4bb5-93a6-154a53080048 req-47670665-d236-403e-8fe5-a2bacd9aaa1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d99b83-36d5-48e9-9557-95e6f29f9f7e", "name": "network-vif-deleted", "tag": "839607fb-10e5-4eaf-a58d-d39ced8e7b5a"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:31:59.085029 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fde081c8-ec9e-4bb5-93a6-154a53080048 req-47670665-d236-403e-8fe5-a2bacd9aaa1f service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:59.085468 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fde081c8-ec9e-4bb5-93a6-154a53080048 req-47670665-d236-403e-8fe5-a2bacd9aaa1f service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:59.097526 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-fde081c8-ec9e-4bb5-93a6-154a53080048 req-47670665-d236-403e-8fe5-a2bacd9aaa1f service nova] Creating event network-vif-deleted:839607fb-10e5-4eaf-a58d-d39ced8e7b5a for instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e on hv-cinder-84733 Jun 29 11:31:59.103128 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-fde081c8-ec9e-4bb5-93a6-154a53080048 req-47670665-d236-403e-8fe5-a2bacd9aaa1f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094224 Jun 29 11:31:59.104162 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 343/674] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:31:59.547735 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b168e96a-5043-4be1-b0c4-0739af9f8edd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:59.548369 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b168e96a-5043-4be1-b0c4-0739af9f8edd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:59.554390 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b168e96a-5043-4be1-b0c4-0739af9f8edd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:59.554830 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b168e96a-5043-4be1-b0c4-0739af9f8edd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:59.555578 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b168e96a-5043-4be1-b0c4-0739af9f8edd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:59.556071 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b168e96a-5043-4be1-b0c4-0739af9f8edd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:59.619888 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b168e96a-5043-4be1-b0c4-0739af9f8edd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:31:59.627554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b168e96a-5043-4be1-b0c4-0739af9f8edd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 200 len: 1226 microversion: 2.1 time: 0.083744 Jun 29 11:31:59.628086 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 332/675] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:59 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:31:59.694004 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-de806af0-8acd-4a64-8798-d58c98a5baef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:31:59.695077 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-de806af0-8acd-4a64-8798-d58c98a5baef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] [instance: f9821f7d-2d75-40ae-b7a1-81bd38b28a26] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:31:59.702781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de806af0-8acd-4a64-8798-d58c98a5baef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:59.703297 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de806af0-8acd-4a64-8798-d58c98a5baef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:59.704221 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de806af0-8acd-4a64-8798-d58c98a5baef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:31:59.704753 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de806af0-8acd-4a64-8798-d58c98a5baef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:31:59.720482 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-de806af0-8acd-4a64-8798-d58c98a5baef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] HTTP exception thrown: Instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 could not be found. Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-de806af0-8acd-4a64-8798-d58c98a5baef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Request method failure captured: Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 HTTP/1.1 Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZ_hdMYJgq85a0ANpS40L4DnIBMc0L0w2VQmyJptv9vz09vZSHBB5QFP-MIu6lCP_6R2lFejZ1fXBaWqeb2npwIbc3ySbmlrb6USsshKBJfEjko0jZsW2Xjk92OrwImioiZjr5m7Rnec6Fs2oG7eh3N0QRHWm0LQ2lzMoWq-s9mREA Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: cbfba915f70342afb8267e34abc24bfe Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:31:59.722752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:31:59.724330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cbfba915f70342afb8267e34abc24bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cbfba915f70342afb8267e34abc24bfe", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbfba915f70342afb8267e34abc24bfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbfba915f70342afb8267e34abc24bfe"}]}] Jun 29 11:31:59.724330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:31:59.724330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: cbfba915f70342afb8267e34abc24bfe Jun 29 11:31:59.724330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-21742587 Jun 29 11:31:59.724330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-21742587-project Jun 29 11:31:59.724330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:31:59.724330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:31:59.724330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 8effcd6f6be64f14b3c8bc71f8866a99 Jun 29 11:31:59.724330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-21742587-project Jun 29 11:31:59.724330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:31:59.724330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 could not be found. Jun 29 11:31:59.724330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': 'f9821f7d-2d75-40ae-b7a1-81bd38b28a26'} Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 could not be found. Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:31:59.725245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 could not be found. Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 could not be found. Jun 29 11:31:59.727042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:31:59.728688 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-de806af0-8acd-4a64-8798-d58c98a5baef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] Returning 404 to user: Instance f9821f7d-2d75-40ae-b7a1-81bd38b28a26 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:31:59.728688 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-de806af0-8acd-4a64-8798-d58c98a5baef tempest-ServerRescueNegativeTestJSON-21742587 tempest-ServerRescueNegativeTestJSON-21742587-project] 10.222.0.44 "GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26" status: 404 len: 111 microversion: 2.1 time: 0.034841 Jun 29 11:31:59.728688 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 344/676] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:31:59 2022] GET /compute/v2.1/servers/f9821f7d-2d75-40ae-b7a1-81bd38b28a26 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:32:00.643616 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-feee11cd-add9-413c-8ac5-15e5a92351db tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:00.644252 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-feee11cd-add9-413c-8ac5-15e5a92351db tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:00.650757 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-feee11cd-add9-413c-8ac5-15e5a92351db tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:00.651214 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-feee11cd-add9-413c-8ac5-15e5a92351db tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:00.652843 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-feee11cd-add9-413c-8ac5-15e5a92351db tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:00.652843 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-feee11cd-add9-413c-8ac5-15e5a92351db tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:00.665606 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-feee11cd-add9-413c-8ac5-15e5a92351db tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] HTTP exception thrown: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-feee11cd-add9-413c-8ac5-15e5a92351db tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Request method failure captured: Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e HTTP/1.1 Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDczywj0HT1KRfuqpM0zP2C-D8VWM0B9Cr_89zQLJwK_Y2CyTZ4V0G0tlk01Xy1o58iLJnv7CwMzJlOapUbyuh6zZDVPCmgix0rRtMV6_g27ltkHqUycI8UEfLBLFnhnMnP7olJV9yWa_FVD01xdlqfIGl4jLQCAEr0vFCiTmMW0P0w Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: cdc0456bfa5a4619a96b41d3437fd82c Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:32:00.667728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:32:00.669306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cdc0456bfa5a4619a96b41d3437fd82c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cdc0456bfa5a4619a96b41d3437fd82c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cdc0456bfa5a4619a96b41d3437fd82c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cdc0456bfa5a4619a96b41d3437fd82c"}]}] Jun 29 11:32:00.669306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:32:00.669306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: cdc0456bfa5a4619a96b41d3437fd82c Jun 29 11:32:00.669306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:32:00.669306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-TestVolumeBootPattern-1359380287-project Jun 29 11:32:00.669306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:32:00.669306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:32:00.669306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: e91cc0b93f484f759233469ec5f37bb4 Jun 29 11:32:00.669306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-TestVolumeBootPattern-1359380287-project Jun 29 11:32:00.669306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:32:00.669306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:32:00.669306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': '44d99b83-36d5-48e9-9557-95e6f29f9f7e'} Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:32:00.670228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:32:00.671590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:00.676703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-feee11cd-add9-413c-8ac5-15e5a92351db tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Returning 404 to user: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:32:00.676703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-feee11cd-add9-413c-8ac5-15e5a92351db tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 404 len: 111 microversion: 2.1 time: 0.029398 Jun 29 11:32:00.676703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 333/677] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:00 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:32:00.764447 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1772874291", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2084883613", "security_groups": [{"name": "tempest-secgroup-smoke-254433816"}], "block_device_mapping_v2": [{"uuid": "ae1fe5d9-acee-4c2c-a7b6-1361a573bcea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "565f4274-f756-4c7f-9d43-992c92750ab4"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:00.927939 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] validate_networks() for [('565f4274-f756-4c7f-9d43-992c92750ab4', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:32:01.590714 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:32:01.591923 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:32:01.592583 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:32:01.593776 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:32:01.594642 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:32:01.604583 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:01.605049 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:01.605846 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:01.606285 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:01.627017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Getting quotas for project cdc0456bfa5a4619a96b41d3437fd82c. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:32:01.631294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Getting quotas for user e91cc0b93f484f759233469ec5f37bb4 and project cdc0456bfa5a4619a96b41d3437fd82c. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:32:01.697681 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:32:01.700339 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae1fe5d9-acee-4c2c-a7b6-1361a573bcea',volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:32:02.174454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c3e508df-d594-4108-a616-db2eb3297265 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.414132 Jun 29 11:32:02.175191 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 345/678] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:32:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:32:02.186228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7683dcc1-3143-427c-b024-007392e55fd6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:02.186841 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7683dcc1-3143-427c-b024-007392e55fd6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:02.241920 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7683dcc1-3143-427c-b024-007392e55fd6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:02.249287 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7683dcc1-3143-427c-b024-007392e55fd6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1095 microversion: 2.1 time: 0.067535 Jun 29 11:32:02.249850 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 334/679] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:02 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:03.268066 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f190300-b475-49b7-b761-b7386b39ef41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:03.268887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6f190300-b475-49b7-b761-b7386b39ef41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:03.276279 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f190300-b475-49b7-b761-b7386b39ef41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:03.277053 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f190300-b475-49b7-b761-b7386b39ef41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:03.278107 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f190300-b475-49b7-b761-b7386b39ef41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:03.278578 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f190300-b475-49b7-b761-b7386b39ef41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:03.344352 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6f190300-b475-49b7-b761-b7386b39ef41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:03.351623 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6f190300-b475-49b7-b761-b7386b39ef41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1145 microversion: 2.1 time: 0.087820 Jun 29 11:32:03.352672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 346/680] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:03 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:04.368401 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4e0eedf6-ad89-4520-9a98-e5e6d5db270b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:04.369401 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4e0eedf6-ad89-4520-9a98-e5e6d5db270b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:04.382392 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4e0eedf6-ad89-4520-9a98-e5e6d5db270b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:04.382835 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4e0eedf6-ad89-4520-9a98-e5e6d5db270b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:04.383603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4e0eedf6-ad89-4520-9a98-e5e6d5db270b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:04.384060 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4e0eedf6-ad89-4520-9a98-e5e6d5db270b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:04.389186 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:04.449859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4e0eedf6-ad89-4520-9a98-e5e6d5db270b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:04.462761 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4e0eedf6-ad89-4520-9a98-e5e6d5db270b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1211 microversion: 2.1 time: 0.094414 Jun 29 11:32:04.462761 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 335/681] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:04 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:05.477351 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c91057bf-7fe3-4486-9151-152e9dbbe86c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:05.477885 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c91057bf-7fe3-4486-9151-152e9dbbe86c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:05.485051 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c91057bf-7fe3-4486-9151-152e9dbbe86c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:05.485493 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c91057bf-7fe3-4486-9151-152e9dbbe86c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:05.486925 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c91057bf-7fe3-4486-9151-152e9dbbe86c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:05.487844 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c91057bf-7fe3-4486-9151-152e9dbbe86c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:05.671517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c91057bf-7fe3-4486-9151-152e9dbbe86c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:05.678955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c91057bf-7fe3-4486-9151-152e9dbbe86c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1278 microversion: 2.1 time: 0.205864 Jun 29 11:32:05.679522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 347/682] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:05 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:06.028376 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-26d7a2a5-ec76-464b-ab2b-d9a86f8f6230 req-92e59413-8da3-4c6c-8283-8d2f44f38d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00bf9bd8-c879-4105-8185-5390ce9d61aa", "tag": "b4466d29-fb33-463a-8b05-3045971a9d75"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:06.045991 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-26d7a2a5-ec76-464b-ab2b-d9a86f8f6230 req-92e59413-8da3-4c6c-8283-8d2f44f38d47 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:06.046433 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-26d7a2a5-ec76-464b-ab2b-d9a86f8f6230 req-92e59413-8da3-4c6c-8283-8d2f44f38d47 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:06.059280 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-26d7a2a5-ec76-464b-ab2b-d9a86f8f6230 req-92e59413-8da3-4c6c-8283-8d2f44f38d47 service nova] Creating event network-changed:b4466d29-fb33-463a-8b05-3045971a9d75 for instance 00bf9bd8-c879-4105-8185-5390ce9d61aa on hv-cinder-84733 Jun 29 11:32:06.065017 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-26d7a2a5-ec76-464b-ab2b-d9a86f8f6230 req-92e59413-8da3-4c6c-8283-8d2f44f38d47 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047444 Jun 29 11:32:06.074019 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 336/683] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:06.694902 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-067bbed8-e366-4275-834b-ce14a3879fae tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:06.695522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-067bbed8-e366-4275-834b-ce14a3879fae tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:06.698001 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:06.703194 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-067bbed8-e366-4275-834b-ce14a3879fae tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:06.703894 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-067bbed8-e366-4275-834b-ce14a3879fae tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:06.704845 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-067bbed8-e366-4275-834b-ce14a3879fae tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:06.705291 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-067bbed8-e366-4275-834b-ce14a3879fae tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:06.874259 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-067bbed8-e366-4275-834b-ce14a3879fae tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:06.883317 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-067bbed8-e366-4275-834b-ce14a3879fae tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.192138 Jun 29 11:32:06.884228 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 348/684] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:06 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:07.901896 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9e65bb88-ad5c-41d9-beea-b6302c0e0185 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:07.902611 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9e65bb88-ad5c-41d9-beea-b6302c0e0185 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:07.906298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:07.910789 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e65bb88-ad5c-41d9-beea-b6302c0e0185 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:07.911465 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e65bb88-ad5c-41d9-beea-b6302c0e0185 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:07.912275 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e65bb88-ad5c-41d9-beea-b6302c0e0185 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:07.912710 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e65bb88-ad5c-41d9-beea-b6302c0e0185 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:08.056929 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9e65bb88-ad5c-41d9-beea-b6302c0e0185 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:08.064911 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9e65bb88-ad5c-41d9-beea-b6302c0e0185 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.167792 Jun 29 11:32:08.065490 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 337/685] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:07 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:09.082532 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e1006a74-3f2d-4755-b7df-85e6e85baf16 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:09.083205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e1006a74-3f2d-4755-b7df-85e6e85baf16 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:09.091941 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1006a74-3f2d-4755-b7df-85e6e85baf16 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:09.092414 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1006a74-3f2d-4755-b7df-85e6e85baf16 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:09.093320 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1006a74-3f2d-4755-b7df-85e6e85baf16 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:09.094047 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1006a74-3f2d-4755-b7df-85e6e85baf16 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:09.719619 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e1006a74-3f2d-4755-b7df-85e6e85baf16 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:09.727319 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e1006a74-3f2d-4755-b7df-85e6e85baf16 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.648854 Jun 29 11:32:09.728001 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 349/686] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:09 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:10.747124 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-727a2d66-4452-4526-bd38-b2d928071628 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:10.747573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-727a2d66-4452-4526-bd38-b2d928071628 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:10.755579 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-727a2d66-4452-4526-bd38-b2d928071628 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:10.756191 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-727a2d66-4452-4526-bd38-b2d928071628 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:10.757368 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-727a2d66-4452-4526-bd38-b2d928071628 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:10.758132 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-727a2d66-4452-4526-bd38-b2d928071628 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:11.020075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-727a2d66-4452-4526-bd38-b2d928071628 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:11.025933 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9f72618f-14f0-4727-bdb2-a72bd93810d8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1958344252"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:11.026572 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9f72618f-14f0-4727-bdb2-a72bd93810d8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:11.027953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-727a2d66-4452-4526-bd38-b2d928071628 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.286695 Jun 29 11:32:11.028615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 338/687] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:10 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:11.035550 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f72618f-14f0-4727-bdb2-a72bd93810d8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:11.037660 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f72618f-14f0-4727-bdb2-a72bd93810d8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:11.039726 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f72618f-14f0-4727-bdb2-a72bd93810d8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:11.040275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f72618f-14f0-4727-bdb2-a72bd93810d8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:11.199111 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.network.security_group_api [None req-9f72618f-14f0-4727-bdb2-a72bd93810d8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Removing security group 9342cc18-e8ad-4efd-8e77-676225b16d5a from port fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3 Jun 29 11:32:11.300268 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fb77f3b4-d88a-4f7e-bcf8-6aa7f30307ec tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: .version_select at 0x7fd08958aa60>, body: {"keypair": {"name": "tempest-keypair-1466478267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVf+PM3z9JyVziivGc4zbca4wtAlh7en78y6WMSq83IgMWq3sPosOjVVUJYTcyz0mi1rmywOAqWMxsQGFWXqgAp9LqU898rQk+gYsLGQ8ONA5k75j03Aqil8ur9cJXxWQ=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:11.320170 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-fb77f3b4-d88a-4f7e-bcf8-6aa7f30307ec tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:32:11.325863 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-fb77f3b4-d88a-4f7e-bcf8-6aa7f30307ec tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for user cf7bc4681c954c158a7051046bd9aa47 and project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:32:11.462340 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fb77f3b4-d88a-4f7e-bcf8-6aa7f30307ec tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.308895 Jun 29 11:32:11.462941 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 339/688] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jun 29 11:32:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:32:11.616905 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:11.625585 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9f72618f-14f0-4727-bdb2-a72bd93810d8 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "POST /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/action" status: 202 len: 0 microversion: 2.1 time: 0.603889 Jun 29 11:32:11.626264 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 350/689] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:32:11 2022] POST /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 11:32:11.645834 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-303af854-dd09-4667-a9d7-ed3e814948e8 req-626b0445-0c09-4fa1-98fd-1f89c0b1646a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514fe8ac-ed28-4fb6-8f17-c9e43d34e032", "tag": "fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:11.673362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-303af854-dd09-4667-a9d7-ed3e814948e8 req-626b0445-0c09-4fa1-98fd-1f89c0b1646a service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:11.673362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-303af854-dd09-4667-a9d7-ed3e814948e8 req-626b0445-0c09-4fa1-98fd-1f89c0b1646a service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:11.689805 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-303af854-dd09-4667-a9d7-ed3e814948e8 req-626b0445-0c09-4fa1-98fd-1f89c0b1646a service nova] Creating event network-changed:fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3 for instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 on hv-cinder-84733 Jun 29 11:32:11.695563 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-303af854-dd09-4667-a9d7-ed3e814948e8 req-626b0445-0c09-4fa1-98fd-1f89c0b1646a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057776 Jun 29 11:32:11.699269 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 340/690] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:12.042676 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:12.047479 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2439de3-9559-4f56-8eea-815fc76e70e5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:12.048125 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e2439de3-9559-4f56-8eea-815fc76e70e5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:12.055582 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2439de3-9559-4f56-8eea-815fc76e70e5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:12.056296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2439de3-9559-4f56-8eea-815fc76e70e5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:12.057388 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2439de3-9559-4f56-8eea-815fc76e70e5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:12.058249 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2439de3-9559-4f56-8eea-815fc76e70e5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:12.381773 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e2439de3-9559-4f56-8eea-815fc76e70e5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:12.394027 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2439de3-9559-4f56-8eea-815fc76e70e5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.352429 Jun 29 11:32:12.399065 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 351/691] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:12 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:13.316138 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6eaeea9c-82c3-4512-b1df-402f16727883 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:13.318158 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6eaeea9c-82c3-4512-b1df-402f16727883 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:13.341381 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6eaeea9c-82c3-4512-b1df-402f16727883 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:13.341381 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6eaeea9c-82c3-4512-b1df-402f16727883 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:13.341381 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6eaeea9c-82c3-4512-b1df-402f16727883 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:13.341381 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6eaeea9c-82c3-4512-b1df-402f16727883 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:13.413583 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-96de5e86-a75a-4847-a307-2c139e8598d6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:13.414335 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-96de5e86-a75a-4847-a307-2c139e8598d6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:13.422936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96de5e86-a75a-4847-a307-2c139e8598d6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:13.423379 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96de5e86-a75a-4847-a307-2c139e8598d6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:13.424175 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96de5e86-a75a-4847-a307-2c139e8598d6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:13.424762 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96de5e86-a75a-4847-a307-2c139e8598d6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:13.442422 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-6eaeea9c-82c3-4512-b1df-402f16727883 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lazy-loading 'services' on Instance uuid 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:32:13.666554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6eaeea9c-82c3-4512-b1df-402f16727883 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "DELETE /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments/63ad26be-d38d-4d1f-a6a2-4fd382e15331" status: 202 len: 0 microversion: 2.1 time: 0.355546 Jun 29 11:32:13.668126 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 341/692] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jun 29 11:32:13 2022] DELETE /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments/63ad26be-d38d-4d1f-a6a2-4fd382e15331 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:32:13.679483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a92d7faf-b152-4fb9-9822-5f181d580a4e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:13.681853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a92d7faf-b152-4fb9-9822-5f181d580a4e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:13.701373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a92d7faf-b152-4fb9-9822-5f181d580a4e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:13.702120 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a92d7faf-b152-4fb9-9822-5f181d580a4e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:13.703222 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a92d7faf-b152-4fb9-9822-5f181d580a4e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:13.704292 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a92d7faf-b152-4fb9-9822-5f181d580a4e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:13.765997 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96de5e86-a75a-4847-a307-2c139e8598d6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:13.775488 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-96de5e86-a75a-4847-a307-2c139e8598d6 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.367091 Jun 29 11:32:13.783889 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 352/693] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:13 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:13.790153 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-256b6cb3-5da6-433c-8957-f1134b33b937 req-f87bdd11-4261-48b7-a0cb-259dd4929aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514fe8ac-ed28-4fb6-8f17-c9e43d34e032", "tag": "fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:13.799962 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a92d7faf-b152-4fb9-9822-5f181d580a4e tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126202 Jun 29 11:32:13.801246 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 342/694] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:32:13 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:13.801602 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-256b6cb3-5da6-433c-8957-f1134b33b937 req-f87bdd11-4261-48b7-a0cb-259dd4929aaf service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:13.802277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-256b6cb3-5da6-433c-8957-f1134b33b937 req-f87bdd11-4261-48b7-a0cb-259dd4929aaf service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:13.816736 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-256b6cb3-5da6-433c-8957-f1134b33b937 req-f87bdd11-4261-48b7-a0cb-259dd4929aaf service nova] Creating event network-changed:fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3 for instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 on hv-cinder-84733 Jun 29 11:32:13.824836 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-256b6cb3-5da6-433c-8957-f1134b33b937 req-f87bdd11-4261-48b7-a0cb-259dd4929aaf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044335 Jun 29 11:32:13.827218 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 353/695] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:14.663249 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1017003653", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42f5ddc9-93c3-4cb7-9c4a-2481dc4d5579"}], "security_groups": [{"name": "tempest-securitygroup--1407999082"}], "key_name": "tempest-keypair-1466478267", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:14.774427 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] validate_networks() for [('42f5ddc9-93c3-4cb7-9c4a-2481dc4d5579', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:32:14.796966 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9a339b8c-e3da-4692-9a88-b4a9e70e963e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:14.797687 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9a339b8c-e3da-4692-9a88-b4a9e70e963e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:14.806039 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a339b8c-e3da-4692-9a88-b4a9e70e963e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:14.806039 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a339b8c-e3da-4692-9a88-b4a9e70e963e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:14.806319 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a339b8c-e3da-4692-9a88-b4a9e70e963e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:14.806529 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a339b8c-e3da-4692-9a88-b4a9e70e963e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:15.144026 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9a339b8c-e3da-4692-9a88-b4a9e70e963e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:15.152860 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9a339b8c-e3da-4692-9a88-b4a9e70e963e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.359913 Jun 29 11:32:15.153764 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 354/696] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:14 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:15.167171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b419de69-0ed6-429b-9bf9-5f33efd62cb9 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:15.168154 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b419de69-0ed6-429b-9bf9-5f33efd62cb9 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:15.177779 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b419de69-0ed6-429b-9bf9-5f33efd62cb9 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:15.178228 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b419de69-0ed6-429b-9bf9-5f33efd62cb9 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:15.179006 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b419de69-0ed6-429b-9bf9-5f33efd62cb9 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:15.179438 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b419de69-0ed6-429b-9bf9-5f33efd62cb9 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:15.210037 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b419de69-0ed6-429b-9bf9-5f33efd62cb9 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054782 Jun 29 11:32:15.210957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 355/697] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:32:15 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:15.380290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:32:15.382437 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:32:15.382437 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:32:15.382437 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:32:15.382437 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:32:15.393494 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:15.393935 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:15.394727 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:15.395157 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:15.414031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:32:15.418828 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for user cf7bc4681c954c158a7051046bd9aa47 and project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:32:15.430044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:32:15.432518 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:32:15.544422 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-22ae7104-6268-4936-be6c-240b126233c4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.885333 Jun 29 11:32:15.550161 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 343/698] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:32:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:32:15.555247 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c741865e-f9da-47d4-bfd2-3d34dd777b28 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:15.555980 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c741865e-f9da-47d4-bfd2-3d34dd777b28 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:15.580130 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4d4b31ae-7d8d-4ca3-b4e1-382569b5bef6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:15.581201 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4d4b31ae-7d8d-4ca3-b4e1-382569b5bef6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:15.587962 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d4b31ae-7d8d-4ca3-b4e1-382569b5bef6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:15.593578 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d4b31ae-7d8d-4ca3-b4e1-382569b5bef6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:15.593578 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d4b31ae-7d8d-4ca3-b4e1-382569b5bef6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:15.593578 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d4b31ae-7d8d-4ca3-b4e1-382569b5bef6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:15.622950 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c741865e-f9da-47d4-bfd2-3d34dd777b28 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:15.623777 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4d4b31ae-7d8d-4ca3-b4e1-382569b5bef6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047792 Jun 29 11:32:15.624388 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 344/699] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:32:15 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 11:32:15.629947 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c741865e-f9da-47d4-bfd2-3d34dd777b28 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1242 microversion: 2.1 time: 0.078871 Jun 29 11:32:15.630811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 356/700] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:15 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:15.685598 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-239b59c3-9292-46c5-8bf8-d41031c8a939 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:15.686083 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-239b59c3-9292-46c5-8bf8-d41031c8a939 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:15.695581 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-239b59c3-9292-46c5-8bf8-d41031c8a939 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:15.696022 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-239b59c3-9292-46c5-8bf8-d41031c8a939 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:15.697099 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-239b59c3-9292-46c5-8bf8-d41031c8a939 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:15.697726 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-239b59c3-9292-46c5-8bf8-d41031c8a939 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:15.724320 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-239b59c3-9292-46c5-8bf8-d41031c8a939 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:32:15.999880 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-239b59c3-9292-46c5-8bf8-d41031c8a939 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "DELETE /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 204 len: 0 microversion: 2.1 time: 0.317929 Jun 29 11:32:16.000741 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 345/701] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:32:15 2022] DELETE /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:32:16.009247 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-53affbc8-33f1-4ffa-b502-b79e7cfa7ab7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:16.009794 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-53affbc8-33f1-4ffa-b502-b79e7cfa7ab7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:16.017685 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53affbc8-33f1-4ffa-b502-b79e7cfa7ab7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:16.018909 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53affbc8-33f1-4ffa-b502-b79e7cfa7ab7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:16.019905 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53affbc8-33f1-4ffa-b502-b79e7cfa7ab7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:16.020360 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53affbc8-33f1-4ffa-b502-b79e7cfa7ab7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:16.157727 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-53affbc8-33f1-4ffa-b502-b79e7cfa7ab7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:16.167271 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-53affbc8-33f1-4ffa-b502-b79e7cfa7ab7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1672 microversion: 2.1 time: 0.159905 Jun 29 11:32:16.167271 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 357/702] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:16 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:16.170700 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-42589b57-d1bd-4581-8d94-c05473990bd0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:16.171397 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-42589b57-d1bd-4581-8d94-c05473990bd0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:16.177577 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42589b57-d1bd-4581-8d94-c05473990bd0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:16.178020 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42589b57-d1bd-4581-8d94-c05473990bd0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:16.178771 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42589b57-d1bd-4581-8d94-c05473990bd0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:16.179201 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42589b57-d1bd-4581-8d94-c05473990bd0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:16.221967 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e5280b6c-f616-4269-a5d2-47dd76cd091a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:16.223324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5280b6c-f616-4269-a5d2-47dd76cd091a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:16.230277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5280b6c-f616-4269-a5d2-47dd76cd091a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:16.231013 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5280b6c-f616-4269-a5d2-47dd76cd091a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:16.231932 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5280b6c-f616-4269-a5d2-47dd76cd091a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:16.232462 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5280b6c-f616-4269-a5d2-47dd76cd091a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:16.267710 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e5280b6c-f616-4269-a5d2-47dd76cd091a tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050632 Jun 29 11:32:16.268787 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 358/703] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:32:16 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 11:32:16.278439 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-965d821a-a7ff-42d8-b659-4a74f90b7ec6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:16.279003 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-965d821a-a7ff-42d8-b659-4a74f90b7ec6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:16.285200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-965d821a-a7ff-42d8-b659-4a74f90b7ec6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:16.285700 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-965d821a-a7ff-42d8-b659-4a74f90b7ec6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:16.286471 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-965d821a-a7ff-42d8-b659-4a74f90b7ec6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:16.286888 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-965d821a-a7ff-42d8-b659-4a74f90b7ec6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:16.318412 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-42589b57-d1bd-4581-8d94-c05473990bd0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:16.326547 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-42589b57-d1bd-4581-8d94-c05473990bd0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.159991 Jun 29 11:32:16.327098 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 346/704] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:16 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:16.361899 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-965d821a-a7ff-42d8-b659-4a74f90b7ec6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] HTTP exception thrown: Instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 is not attached to volume 63ad26be-d38d-4d1f-a6a2-4fd382e15331 Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-965d821a-a7ff-42d8-b659-4a74f90b7ec6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Request method failure captured: Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments/63ad26be-d38d-4d1f-a6a2-4fd382e15331 HTTP/1.1 Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDdFjFq2vmniSvciIl3i4MM5McnQU35uH2WjO1s_3RjHis99oCiG_YtHOiadamso1ijEZw4e5fChSX-r1oKG8BJOoLXLOytdYF3b_FNt5-OVHo1CtABj6ZJud1UOnLGHuDO7Cw2ESADj-mH9ZIHz_fNzTKEPfYWCT6SPPDpZ9oBWfYg Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 58aac09bb66b4f98abf47ae8bd863203 Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestMinimumBasicScenario-862188880 Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:32:16.364337 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:32:16.365881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/58aac09bb66b4f98abf47ae8bd863203"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_58aac09bb66b4f98abf47ae8bd863203", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/58aac09bb66b4f98abf47ae8bd863203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/58aac09bb66b4f98abf47ae8bd863203"}]}] Jun 29 11:32:16.365881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestMinimumBasicScenario-862188880 Jun 29 11:32:16.365881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 58aac09bb66b4f98abf47ae8bd863203 Jun 29 11:32:16.365881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestMinimumBasicScenario-862188880 Jun 29 11:32:16.365881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-TestMinimumBasicScenario-862188880-project Jun 29 11:32:16.365881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:32:16.365881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:32:16.365881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 1158e0283f3643669448ca4281e7b1fa Jun 29 11:32:16.365881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestMinimumBasicScenario-862188880-project Jun 29 11:32:16.365881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:32:16.365881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 is not attached to volume 63ad26be-d38d-4d1f-a6a2-4fd382e15331 Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'server_id': '514fe8ac-ed28-4fb6-8f17-c9e43d34e032', 'id': '63ad26be-d38d-4d1f-a6a2-4fd382e15331'} Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 63ad26be-d38d-4d1f-a6a2-4fd382e15331. Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:32:16.366804 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 is not attached to volume 63ad26be-d38d-4d1f-a6a2-4fd382e15331 Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 is not attached to volume 63ad26be-d38d-4d1f-a6a2-4fd382e15331 Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:32:16.368275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-965d821a-a7ff-42d8-b659-4a74f90b7ec6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Returning 404 to user: Instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 is not attached to volume 63ad26be-d38d-4d1f-a6a2-4fd382e15331 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:32:16.369369 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-965d821a-a7ff-42d8-b659-4a74f90b7ec6 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "DELETE /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments/63ad26be-d38d-4d1f-a6a2-4fd382e15331" status: 404 len: 154 microversion: 2.1 time: 0.091269 Jun 29 11:32:16.369369 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 359/705] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jun 29 11:32:16 2022] DELETE /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032/os-volume_attachments/63ad26be-d38d-4d1f-a6a2-4fd382e15331 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 11:32:16.646905 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-aa0da7bb-60ec-4d74-aed2-9b07c5072c65 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:16.647506 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-aa0da7bb-60ec-4d74-aed2-9b07c5072c65 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:16.653663 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa0da7bb-60ec-4d74-aed2-9b07c5072c65 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:16.654104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa0da7bb-60ec-4d74-aed2-9b07c5072c65 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:16.654862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa0da7bb-60ec-4d74-aed2-9b07c5072c65 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:16.655299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aa0da7bb-60ec-4d74-aed2-9b07c5072c65 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:16.940186 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-aa0da7bb-60ec-4d74-aed2-9b07c5072c65 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:16.947538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-aa0da7bb-60ec-4d74-aed2-9b07c5072c65 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1246 microversion: 2.1 time: 0.304525 Jun 29 11:32:16.948127 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 347/706] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:16 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1246 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:17.182604 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aacb29ca-8259-470f-b1f1-960304fae6f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:17.183258 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aacb29ca-8259-470f-b1f1-960304fae6f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:17.190000 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aacb29ca-8259-470f-b1f1-960304fae6f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:17.190448 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aacb29ca-8259-470f-b1f1-960304fae6f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:17.191201 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aacb29ca-8259-470f-b1f1-960304fae6f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:17.191626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aacb29ca-8259-470f-b1f1-960304fae6f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:17.212194 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:17.322241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aacb29ca-8259-470f-b1f1-960304fae6f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:17.330283 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aacb29ca-8259-470f-b1f1-960304fae6f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1672 microversion: 2.1 time: 0.152223 Jun 29 11:32:17.330842 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 360/707] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:17 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:17.343345 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6dec7fca-bc50-42d6-91aa-161c3b8ee204 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:17.344055 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6dec7fca-bc50-42d6-91aa-161c3b8ee204 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:17.350779 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6dec7fca-bc50-42d6-91aa-161c3b8ee204 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:17.351466 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6dec7fca-bc50-42d6-91aa-161c3b8ee204 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:17.352738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6dec7fca-bc50-42d6-91aa-161c3b8ee204 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:17.353540 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6dec7fca-bc50-42d6-91aa-161c3b8ee204 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:17.487244 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6dec7fca-bc50-42d6-91aa-161c3b8ee204 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:17.494953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6dec7fca-bc50-42d6-91aa-161c3b8ee204 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.156077 Jun 29 11:32:17.496034 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 348/708] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:17 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:17.674725 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7f4d16ab-f46f-45d1-b07d-895a945fabb3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:17.675285 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7f4d16ab-f46f-45d1-b07d-895a945fabb3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:17.682023 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f4d16ab-f46f-45d1-b07d-895a945fabb3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:17.682471 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f4d16ab-f46f-45d1-b07d-895a945fabb3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:17.683933 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f4d16ab-f46f-45d1-b07d-895a945fabb3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:17.684551 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f4d16ab-f46f-45d1-b07d-895a945fabb3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:17.711663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7f4d16ab-f46f-45d1-b07d-895a945fabb3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:32:17.964889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4d826392-e4a4-447a-a33b-c80ba6f94ce4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:17.965500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4d826392-e4a4-447a-a33b-c80ba6f94ce4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:17.972238 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d826392-e4a4-447a-a33b-c80ba6f94ce4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:17.972683 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d826392-e4a4-447a-a33b-c80ba6f94ce4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:17.973673 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d826392-e4a4-447a-a33b-c80ba6f94ce4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:17.974111 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4d826392-e4a4-447a-a33b-c80ba6f94ce4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:17.987399 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7f4d16ab-f46f-45d1-b07d-895a945fabb3 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "DELETE /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 204 len: 0 microversion: 2.1 time: 0.316231 Jun 29 11:32:17.988429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 361/709] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:32:17 2022] DELETE /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:32:17.997670 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3205ef56-b7ef-4ced-bb22-ce2bb59e533c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:17.998548 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3205ef56-b7ef-4ced-bb22-ce2bb59e533c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:18.005271 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3205ef56-b7ef-4ced-bb22-ce2bb59e533c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:18.005865 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3205ef56-b7ef-4ced-bb22-ce2bb59e533c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:18.006744 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3205ef56-b7ef-4ced-bb22-ce2bb59e533c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:18.007294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3205ef56-b7ef-4ced-bb22-ce2bb59e533c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:18.057023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4d826392-e4a4-447a-a33b-c80ba6f94ce4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:18.066893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4d826392-e4a4-447a-a33b-c80ba6f94ce4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1294 microversion: 2.1 time: 0.105775 Jun 29 11:32:18.067472 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 349/710] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:17 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:18.170141 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3205ef56-b7ef-4ced-bb22-ce2bb59e533c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:18.177810 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3205ef56-b7ef-4ced-bb22-ce2bb59e533c tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1552 microversion: 2.1 time: 0.185188 Jun 29 11:32:18.178379 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 362/711] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:17 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:18.348349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-559614da-f9e7-466d-9aaf-15c9a5c61e58 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:18.349281 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-559614da-f9e7-466d-9aaf-15c9a5c61e58 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:18.357544 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-559614da-f9e7-466d-9aaf-15c9a5c61e58 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:18.363508 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-559614da-f9e7-466d-9aaf-15c9a5c61e58 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:18.363508 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-559614da-f9e7-466d-9aaf-15c9a5c61e58 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:18.363508 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-559614da-f9e7-466d-9aaf-15c9a5c61e58 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:18.387901 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-8c0caf91-47f0-47a6-9663-22a1f711c97e req-ed755ba1-034b-4811-a1b9-190170aeec00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e", "name": "network-vif-deleted", "tag": "e66cf1ae-bf64-468d-bdce-a480ba5ff33d"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:18.396461 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8c0caf91-47f0-47a6-9663-22a1f711c97e req-ed755ba1-034b-4811-a1b9-190170aeec00 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:18.396899 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8c0caf91-47f0-47a6-9663-22a1f711c97e req-ed755ba1-034b-4811-a1b9-190170aeec00 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:18.408580 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-8c0caf91-47f0-47a6-9663-22a1f711c97e req-ed755ba1-034b-4811-a1b9-190170aeec00 service nova] Creating event network-vif-deleted:e66cf1ae-bf64-468d-bdce-a480ba5ff33d for instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e on hv-cinder-84733 Jun 29 11:32:18.413399 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-8c0caf91-47f0-47a6-9663-22a1f711c97e req-ed755ba1-034b-4811-a1b9-190170aeec00 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029314 Jun 29 11:32:18.413992 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 363/712] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:32:18.434802 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-559614da-f9e7-466d-9aaf-15c9a5c61e58 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:18.442904 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-559614da-f9e7-466d-9aaf-15c9a5c61e58 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1604 microversion: 2.1 time: 0.098493 Jun 29 11:32:18.443859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 350/713] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:18 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:18.512850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f889ecc1-a9a9-4a05-af23-a8097e0fad21 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:18.513816 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f889ecc1-a9a9-4a05-af23-a8097e0fad21 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:18.521113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f889ecc1-a9a9-4a05-af23-a8097e0fad21 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:18.521568 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f889ecc1-a9a9-4a05-af23-a8097e0fad21 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:18.522343 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f889ecc1-a9a9-4a05-af23-a8097e0fad21 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:18.522781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f889ecc1-a9a9-4a05-af23-a8097e0fad21 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:18.670912 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f889ecc1-a9a9-4a05-af23-a8097e0fad21 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:18.678382 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f889ecc1-a9a9-4a05-af23-a8097e0fad21 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.169769 Jun 29 11:32:18.678947 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 364/714] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:18 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:19.084184 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-db084644-98e1-4409-9c51-56b6328328a8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:19.084722 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-db084644-98e1-4409-9c51-56b6328328a8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:19.092453 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db084644-98e1-4409-9c51-56b6328328a8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:19.095944 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db084644-98e1-4409-9c51-56b6328328a8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:19.095944 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db084644-98e1-4409-9c51-56b6328328a8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:19.095944 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db084644-98e1-4409-9c51-56b6328328a8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:19.155852 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-db084644-98e1-4409-9c51-56b6328328a8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:19.163616 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-db084644-98e1-4409-9c51-56b6328328a8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1302 microversion: 2.1 time: 0.083404 Jun 29 11:32:19.164196 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 351/715] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:19 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:19.194368 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7acd8337-d78b-4c5d-963e-c13de69c2428 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:19.194973 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7acd8337-d78b-4c5d-963e-c13de69c2428 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:19.200922 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7acd8337-d78b-4c5d-963e-c13de69c2428 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:19.201363 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7acd8337-d78b-4c5d-963e-c13de69c2428 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:19.202111 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7acd8337-d78b-4c5d-963e-c13de69c2428 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:19.202541 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7acd8337-d78b-4c5d-963e-c13de69c2428 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:19.333989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7acd8337-d78b-4c5d-963e-c13de69c2428 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:19.342211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7acd8337-d78b-4c5d-963e-c13de69c2428 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1552 microversion: 2.1 time: 0.151547 Jun 29 11:32:19.342727 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 365/716] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:19 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:19.461984 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4c54c05a-b848-4bf9-ac76-496a91e59259 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:19.462113 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4c54c05a-b848-4bf9-ac76-496a91e59259 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:19.469888 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c54c05a-b848-4bf9-ac76-496a91e59259 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:19.469888 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c54c05a-b848-4bf9-ac76-496a91e59259 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:19.470329 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c54c05a-b848-4bf9-ac76-496a91e59259 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:19.470781 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4c54c05a-b848-4bf9-ac76-496a91e59259 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:19.491474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:19.535652 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4c54c05a-b848-4bf9-ac76-496a91e59259 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:19.543995 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4c54c05a-b848-4bf9-ac76-496a91e59259 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1604 microversion: 2.1 time: 0.086420 Jun 29 11:32:19.544759 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 352/717] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:19 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1604 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:19.695639 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0ba0ee52-c483-45c8-9711-3201381d7034 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:19.696376 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0ba0ee52-c483-45c8-9711-3201381d7034 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:19.702639 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ba0ee52-c483-45c8-9711-3201381d7034 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:19.703090 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ba0ee52-c483-45c8-9711-3201381d7034 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:19.703871 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ba0ee52-c483-45c8-9711-3201381d7034 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:19.704308 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ba0ee52-c483-45c8-9711-3201381d7034 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:19.858037 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0ba0ee52-c483-45c8-9711-3201381d7034 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:19.865856 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0ba0ee52-c483-45c8-9711-3201381d7034 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.173975 Jun 29 11:32:19.866418 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 366/718] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:19 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:20.112772 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-4a675b4d-2f18-4f9f-9afe-56fcc4f4a1d2 req-b6e71149-9b66-4449-b5ff-e247316fbc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00bf9bd8-c879-4105-8185-5390ce9d61aa", "name": "network-vif-plugged", "status": "completed", "tag": "b4466d29-fb33-463a-8b05-3045971a9d75"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:20.126228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4a675b4d-2f18-4f9f-9afe-56fcc4f4a1d2 req-b6e71149-9b66-4449-b5ff-e247316fbc53 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:20.126769 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4a675b4d-2f18-4f9f-9afe-56fcc4f4a1d2 req-b6e71149-9b66-4449-b5ff-e247316fbc53 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:20.146658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-4a675b4d-2f18-4f9f-9afe-56fcc4f4a1d2 req-b6e71149-9b66-4449-b5ff-e247316fbc53 service nova] Creating event network-vif-plugged:b4466d29-fb33-463a-8b05-3045971a9d75 for instance 00bf9bd8-c879-4105-8185-5390ce9d61aa on hv-cinder-84733 Jun 29 11:32:20.152440 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-4a675b4d-2f18-4f9f-9afe-56fcc4f4a1d2 req-b6e71149-9b66-4449-b5ff-e247316fbc53 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044101 Jun 29 11:32:20.153042 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 353/719] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:20.181290 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4c4ddde7-5151-4a4e-96dd-9e200fc3d0c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:20.181906 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4c4ddde7-5151-4a4e-96dd-9e200fc3d0c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:20.187977 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c4ddde7-5151-4a4e-96dd-9e200fc3d0c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:20.188420 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c4ddde7-5151-4a4e-96dd-9e200fc3d0c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:20.189268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c4ddde7-5151-4a4e-96dd-9e200fc3d0c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:20.189695 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c4ddde7-5151-4a4e-96dd-9e200fc3d0c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:20.258823 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4c4ddde7-5151-4a4e-96dd-9e200fc3d0c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:20.267557 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4c4ddde7-5151-4a4e-96dd-9e200fc3d0c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1312 microversion: 2.1 time: 0.090128 Jun 29 11:32:20.279713 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 367/720] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:20 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:20.360014 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0cd4d8cd-1cb4-4147-8e86-e7eea30fb770 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:20.360943 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0cd4d8cd-1cb4-4147-8e86-e7eea30fb770 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:20.368380 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cd4d8cd-1cb4-4147-8e86-e7eea30fb770 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:20.368828 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cd4d8cd-1cb4-4147-8e86-e7eea30fb770 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:20.369602 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cd4d8cd-1cb4-4147-8e86-e7eea30fb770 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:20.370040 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cd4d8cd-1cb4-4147-8e86-e7eea30fb770 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:20.501281 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0cd4d8cd-1cb4-4147-8e86-e7eea30fb770 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:20.512836 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0cd4d8cd-1cb4-4147-8e86-e7eea30fb770 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1552 microversion: 2.1 time: 0.157351 Jun 29 11:32:20.513414 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 354/721] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:20 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:20.561791 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-57e39094-bfb5-4e7f-9e9d-65f2b0d4bb9b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:20.562424 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-57e39094-bfb5-4e7f-9e9d-65f2b0d4bb9b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:20.569358 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57e39094-bfb5-4e7f-9e9d-65f2b0d4bb9b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:20.569899 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57e39094-bfb5-4e7f-9e9d-65f2b0d4bb9b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:20.570910 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57e39094-bfb5-4e7f-9e9d-65f2b0d4bb9b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:20.571432 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57e39094-bfb5-4e7f-9e9d-65f2b0d4bb9b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:20.627354 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57e39094-bfb5-4e7f-9e9d-65f2b0d4bb9b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:20.629201 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-57e39094-bfb5-4e7f-9e9d-65f2b0d4bb9b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:20.630074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-57e39094-bfb5-4e7f-9e9d-65f2b0d4bb9b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lazy-loading 'fault' on Instance uuid 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:32:20.701906 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-57e39094-bfb5-4e7f-9e9d-65f2b0d4bb9b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:20.710711 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-57e39094-bfb5-4e7f-9e9d-65f2b0d4bb9b tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 200 len: 1325 microversion: 2.1 time: 0.153147 Jun 29 11:32:20.711288 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 368/722] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:20 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 1325 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:20.883005 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6f59cfa1-40d9-4670-a92f-20a1366d6e67 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:20.883656 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6f59cfa1-40d9-4670-a92f-20a1366d6e67 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:20.893771 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f59cfa1-40d9-4670-a92f-20a1366d6e67 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:20.894220 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f59cfa1-40d9-4670-a92f-20a1366d6e67 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:20.896981 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f59cfa1-40d9-4670-a92f-20a1366d6e67 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:20.900265 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f59cfa1-40d9-4670-a92f-20a1366d6e67 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:21.157583 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6f59cfa1-40d9-4670-a92f-20a1366d6e67 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:21.169690 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6f59cfa1-40d9-4670-a92f-20a1366d6e67 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.290811 Jun 29 11:32:21.170380 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 355/723] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:20 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:21.286013 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-844b5729-dd69-468b-b9c4-fea256ae21c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:21.286625 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-844b5729-dd69-468b-b9c4-fea256ae21c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:21.293188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-844b5729-dd69-468b-b9c4-fea256ae21c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:21.293630 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-844b5729-dd69-468b-b9c4-fea256ae21c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:21.294389 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-844b5729-dd69-468b-b9c4-fea256ae21c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:21.294816 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-844b5729-dd69-468b-b9c4-fea256ae21c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:21.518916 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-80e7ac46-c451-499f-82dd-a61cce55de00 req-77675451-8823-4fbf-983d-56059dfc4b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514fe8ac-ed28-4fb6-8f17-c9e43d34e032", "name": "network-vif-deleted", "tag": "fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:21.528496 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-80e7ac46-c451-499f-82dd-a61cce55de00 req-77675451-8823-4fbf-983d-56059dfc4b0f service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:21.534146 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-80e7ac46-c451-499f-82dd-a61cce55de00 req-77675451-8823-4fbf-983d-56059dfc4b0f service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:21.541623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-80e7ac46-c451-499f-82dd-a61cce55de00 req-77675451-8823-4fbf-983d-56059dfc4b0f service nova] Creating event network-vif-deleted:fdb4dfb2-9d8c-4ff8-9fa3-72036ed203f3 for instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 on hv-cinder-84733 Jun 29 11:32:21.548169 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-80e7ac46-c451-499f-82dd-a61cce55de00 req-77675451-8823-4fbf-983d-56059dfc4b0f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033363 Jun 29 11:32:21.549179 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 356/724] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:32:21.554919 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4426e215-94b3-4df8-8533-fc1c634c1cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:21.555617 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4426e215-94b3-4df8-8533-fc1c634c1cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:21.556977 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-844b5729-dd69-468b-b9c4-fea256ae21c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:21.562260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4426e215-94b3-4df8-8533-fc1c634c1cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:21.562710 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4426e215-94b3-4df8-8533-fc1c634c1cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:21.566123 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4426e215-94b3-4df8-8533-fc1c634c1cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:21.566123 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4426e215-94b3-4df8-8533-fc1c634c1cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:21.566582 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-844b5729-dd69-468b-b9c4-fea256ae21c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1368 microversion: 2.1 time: 0.283383 Jun 29 11:32:21.566682 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 369/725] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:21 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:21.635295 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4426e215-94b3-4df8-8533-fc1c634c1cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:21.643223 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4426e215-94b3-4df8-8533-fc1c634c1cde tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1510 microversion: 2.1 time: 0.092890 Jun 29 11:32:21.643778 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 357/726] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:21 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1510 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:21.716006 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-4b370926-1e9d-4b4c-839b-d02fd85818ce req-566caae3-0e4c-44e2-bd24-b48414658832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858", "tag": "2cf96133-2999-42a7-a7e8-23dae89812c7"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:21.725761 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4b370926-1e9d-4b4c-839b-d02fd85818ce req-566caae3-0e4c-44e2-bd24-b48414658832 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:21.726236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4b370926-1e9d-4b4c-839b-d02fd85818ce req-566caae3-0e4c-44e2-bd24-b48414658832 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:21.730488 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-32bb7a6e-4623-474d-854b-f99e6806c3f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:21.732840 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-32bb7a6e-4623-474d-854b-f99e6806c3f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:21.739150 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-4b370926-1e9d-4b4c-839b-d02fd85818ce req-566caae3-0e4c-44e2-bd24-b48414658832 service nova] Creating event network-changed:2cf96133-2999-42a7-a7e8-23dae89812c7 for instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 on hv-cinder-84733 Jun 29 11:32:21.744092 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-4b370926-1e9d-4b4c-839b-d02fd85818ce req-566caae3-0e4c-44e2-bd24-b48414658832 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032987 Jun 29 11:32:21.744779 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 370/727] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:21.748167 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32bb7a6e-4623-474d-854b-f99e6806c3f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:21.748991 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32bb7a6e-4623-474d-854b-f99e6806c3f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:21.749929 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32bb7a6e-4623-474d-854b-f99e6806c3f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:21.750531 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32bb7a6e-4623-474d-854b-f99e6806c3f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:21.765838 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-32bb7a6e-4623-474d-854b-f99e6806c3f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] HTTP exception thrown: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-32bb7a6e-4623-474d-854b-f99e6806c3f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Request method failure captured: Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e HTTP/1.1 Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDZ-8incjbxmujlKuz3CJQOJVBav3TyJX0tubvWNLqyuwRTccMSn2gin46DfsQlkeN5Y83bNa_FLdcRdpaaK-PKnVX3BsbA4w-G6gDdr1-F4mZVddanDg40Wvy10jB_zatiuJWwnnpS_u2j-nmz-Gk2xRA9e8J2fkCRDFiMFCniKkOk Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 2c08a3d7e74f45999d1ba0ab11781458 Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:32:21.767483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:32:21.769173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2c08a3d7e74f45999d1ba0ab11781458"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2c08a3d7e74f45999d1ba0ab11781458", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c08a3d7e74f45999d1ba0ab11781458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c08a3d7e74f45999d1ba0ab11781458"}]}] Jun 29 11:32:21.769173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:32:21.769173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 2c08a3d7e74f45999d1ba0ab11781458 Jun 29 11:32:21.769173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:32:21.769173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeTestJSON-1285507198-project Jun 29 11:32:21.769173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:32:21.769173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:32:21.769173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: f75e0b3528b14856b73dc441c52d1d73 Jun 29 11:32:21.769173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeTestJSON-1285507198-project Jun 29 11:32:21.769173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:32:21.769173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:32:21.769173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': '00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e'} Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:32:21.770056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:32:21.771474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:21.772902 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-32bb7a6e-4623-474d-854b-f99e6806c3f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Returning 404 to user: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:32:21.772902 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-32bb7a6e-4623-474d-854b-f99e6806c3f7 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 404 len: 111 microversion: 2.1 time: 0.044194 Jun 29 11:32:21.772902 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 358/728] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:21 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:32:21.778919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e363bf8f-735a-4521-bbe0-9e4c55fca4ee tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '.version_select at 0x7fd089336820>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:21.863481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e363bf8f-735a-4521-bbe0-9e4c55fca4ee tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-86607036" status: 202 len: 0 microversion: 2.1 time: 0.088767 Jun 29 11:32:21.868017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 371/729] 10.222.0.44 () {58 vars in 1214 bytes} [Wed Jun 29 11:32:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-86607036 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:32:22.191570 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4932d3a0-640a-4e2f-ab1c-10a48cf4bf06 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:22.192204 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4932d3a0-640a-4e2f-ab1c-10a48cf4bf06 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:22.204359 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4932d3a0-640a-4e2f-ab1c-10a48cf4bf06 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:22.204798 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4932d3a0-640a-4e2f-ab1c-10a48cf4bf06 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:22.215666 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4932d3a0-640a-4e2f-ab1c-10a48cf4bf06 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:22.216157 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4932d3a0-640a-4e2f-ab1c-10a48cf4bf06 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:22.434431 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4932d3a0-640a-4e2f-ab1c-10a48cf4bf06 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:22.441900 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4932d3a0-640a-4e2f-ab1c-10a48cf4bf06 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1266 microversion: 2.1 time: 0.254254 Jun 29 11:32:22.442468 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 359/730] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:22 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:22.582651 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c3c8d8db-e4b7-4e62-a171-65b0a30375d8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:22.583415 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c3c8d8db-e4b7-4e62-a171-65b0a30375d8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:22.590401 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3c8d8db-e4b7-4e62-a171-65b0a30375d8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:22.590847 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3c8d8db-e4b7-4e62-a171-65b0a30375d8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:22.591638 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3c8d8db-e4b7-4e62-a171-65b0a30375d8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:22.592095 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3c8d8db-e4b7-4e62-a171-65b0a30375d8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:22.660805 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-878e314c-9937-485f-b029-81fef1f98acc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:22.661412 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-878e314c-9937-485f-b029-81fef1f98acc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:22.667706 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-878e314c-9937-485f-b029-81fef1f98acc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:22.668189 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-878e314c-9937-485f-b029-81fef1f98acc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:22.668958 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-878e314c-9937-485f-b029-81fef1f98acc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:22.669391 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-878e314c-9937-485f-b029-81fef1f98acc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:22.703538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-878e314c-9937-485f-b029-81fef1f98acc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:22.704083 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-878e314c-9937-485f-b029-81fef1f98acc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:22.704443 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-878e314c-9937-485f-b029-81fef1f98acc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lazy-loading 'fault' on Instance uuid 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:32:22.784882 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-878e314c-9937-485f-b029-81fef1f98acc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1158e0283f3643669448ca4281e7b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58aac09bb66b4f98abf47ae8bd863203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:22.792780 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-878e314c-9937-485f-b029-81fef1f98acc tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 200 len: 1347 microversion: 2.1 time: 0.135923 Jun 29 11:32:22.795030 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 360/731] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:22 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 1347 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:22.834212 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c3c8d8db-e4b7-4e62-a171-65b0a30375d8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:22.849568 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c3c8d8db-e4b7-4e62-a171-65b0a30375d8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1368 microversion: 2.1 time: 0.270859 Jun 29 11:32:22.854702 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 372/732] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:22 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:22.872444 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-73ba229d-f775-4ef9-927e-d8f3ae1a00c4 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Action: 'create', calling method: .version_select at 0x7fd089629ee0>, body: {"keypair": {"name": "tempest-keypair-945297564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpKBnyZVDr3Fq7jdoSZkVavuOaAGC0gX/mNj/e3Ghr0zEjoxut3xfAx4dOlSn/mLINKRBJ9me9+cH5erMwiJHUz7vVIyx/81ek4nltRD7c0JymX/ORj4O5xq2E5slKX0A=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:22.886872 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-73ba229d-f775-4ef9-927e-d8f3ae1a00c4 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Getting quotas for project 2c08a3d7e74f45999d1ba0ab11781458. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:32:22.890749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-73ba229d-f775-4ef9-927e-d8f3ae1a00c4 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Getting quotas for user f75e0b3528b14856b73dc441c52d1d73 and project 2c08a3d7e74f45999d1ba0ab11781458. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:32:22.994546 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-73ba229d-f775-4ef9-927e-d8f3ae1a00c4 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126582 Jun 29 11:32:22.995088 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 361/733] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jun 29 11:32:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:23.458970 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65c9389d-793c-4c72-b086-086ddd02bb41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:23.459596 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-65c9389d-793c-4c72-b086-086ddd02bb41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:23.466618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65c9389d-793c-4c72-b086-086ddd02bb41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:23.467063 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65c9389d-793c-4c72-b086-086ddd02bb41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:23.468060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65c9389d-793c-4c72-b086-086ddd02bb41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:23.468496 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65c9389d-793c-4c72-b086-086ddd02bb41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:23.627892 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-65c9389d-793c-4c72-b086-086ddd02bb41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:23.635532 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-65c9389d-793c-4c72-b086-086ddd02bb41 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1452 microversion: 2.1 time: 0.180820 Jun 29 11:32:23.636148 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 373/734] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:23 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:23.652728 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-58786230-e208-4614-987f-822b8c108078 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:23.653359 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-58786230-e208-4614-987f-822b8c108078 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:23.659295 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58786230-e208-4614-987f-822b8c108078 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:23.659732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58786230-e208-4614-987f-822b8c108078 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:23.660516 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58786230-e208-4614-987f-822b8c108078 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:23.660949 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58786230-e208-4614-987f-822b8c108078 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:23.798032 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-58786230-e208-4614-987f-822b8c108078 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:23.805685 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-58786230-e208-4614-987f-822b8c108078 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1452 microversion: 2.1 time: 0.157846 Jun 29 11:32:23.806200 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 362/735] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:23 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:23.817219 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1077280f-e931-4f6e-b2ec-7567a6433038 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:23.817219 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1077280f-e931-4f6e-b2ec-7567a6433038 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] [instance: 514fe8ac-ed28-4fb6-8f17-c9e43d34e032] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:23.817219 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1077280f-e931-4f6e-b2ec-7567a6433038 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:23.817488 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1077280f-e931-4f6e-b2ec-7567a6433038 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:23.818085 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1077280f-e931-4f6e-b2ec-7567a6433038 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:23.818462 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1077280f-e931-4f6e-b2ec-7567a6433038 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:23.832538 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-1077280f-e931-4f6e-b2ec-7567a6433038 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] HTTP exception thrown: Instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 could not be found. Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1077280f-e931-4f6e-b2ec-7567a6433038 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Request method failure captured: Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 HTTP/1.1 Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDdFjFq2vmniSvciIl3i4MM5McnQU35uH2WjO1s_3RjHis99oCiG_YtHOiadamso1ijEZw4e5fChSX-r1oKG8BJOoLXLOytdYF3b_FNt5-OVHo1CtABj6ZJud1UOnLGHuDO7Cw2ESADj-mH9ZIHz_fNzTKEPfYWCT6SPPDpZ9oBWfYg Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 58aac09bb66b4f98abf47ae8bd863203 Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestMinimumBasicScenario-862188880 Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:32:23.834203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:32:23.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/58aac09bb66b4f98abf47ae8bd863203"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_58aac09bb66b4f98abf47ae8bd863203", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/58aac09bb66b4f98abf47ae8bd863203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/58aac09bb66b4f98abf47ae8bd863203"}]}] Jun 29 11:32:23.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestMinimumBasicScenario-862188880 Jun 29 11:32:23.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 58aac09bb66b4f98abf47ae8bd863203 Jun 29 11:32:23.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestMinimumBasicScenario-862188880 Jun 29 11:32:23.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-TestMinimumBasicScenario-862188880-project Jun 29 11:32:23.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:32:23.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:32:23.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 1158e0283f3643669448ca4281e7b1fa Jun 29 11:32:23.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestMinimumBasicScenario-862188880-project Jun 29 11:32:23.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:32:23.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 could not be found. Jun 29 11:32:23.842021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '514fe8ac-ed28-4fb6-8f17-c9e43d34e032'} Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 could not be found. Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:32:23.842741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 could not be found. Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 could not be found. Jun 29 11:32:23.843936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:32:23.845088 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1077280f-e931-4f6e-b2ec-7567a6433038 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Returning 404 to user: Instance 514fe8ac-ed28-4fb6-8f17-c9e43d34e032 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:32:23.845088 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1077280f-e931-4f6e-b2ec-7567a6433038 tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032" status: 404 len: 111 microversion: 2.1 time: 0.031467 Jun 29 11:32:23.845088 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 374/736] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:23 2022] GET /compute/v2.1/servers/514fe8ac-ed28-4fb6-8f17-c9e43d34e032 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 11:32:23.846939 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a049cda7-d75f-4185-b316-843b09890aba tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] Calling method '.version_select at 0x7fd0896291f0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:23.866424 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7b33a544-95ce-411f-99af-1cc22bd9b6a7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:23.867074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7b33a544-95ce-411f-99af-1cc22bd9b6a7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:23.873420 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b33a544-95ce-411f-99af-1cc22bd9b6a7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:23.873876 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b33a544-95ce-411f-99af-1cc22bd9b6a7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:23.879985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b33a544-95ce-411f-99af-1cc22bd9b6a7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:23.879985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b33a544-95ce-411f-99af-1cc22bd9b6a7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:23.926482 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a049cda7-d75f-4185-b316-843b09890aba tempest-TestMinimumBasicScenario-862188880 tempest-TestMinimumBasicScenario-862188880-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-923554176" status: 202 len: 0 microversion: 2.1 time: 0.083439 Jun 29 11:32:23.927207 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 363/737] 10.222.0.44 () {58 vars in 1268 bytes} [Wed Jun 29 11:32:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-923554176 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:32:24.098097 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7b33a544-95ce-411f-99af-1cc22bd9b6a7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:24.108423 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7b33a544-95ce-411f-99af-1cc22bd9b6a7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1368 microversion: 2.1 time: 0.245364 Jun 29 11:32:24.113548 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 375/738] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:23 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:25.131487 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-166832e6-c1f5-45a6-a36f-f4778b43cb8f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:25.133344 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-166832e6-c1f5-45a6-a36f-f4778b43cb8f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:25.135613 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:25.140997 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-166832e6-c1f5-45a6-a36f-f4778b43cb8f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:25.141453 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-166832e6-c1f5-45a6-a36f-f4778b43cb8f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:25.142246 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-166832e6-c1f5-45a6-a36f-f4778b43cb8f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:25.142688 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-166832e6-c1f5-45a6-a36f-f4778b43cb8f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:25.402919 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:25.549290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-166832e6-c1f5-45a6-a36f-f4778b43cb8f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:25.557248 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-166832e6-c1f5-45a6-a36f-f4778b43cb8f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1368 microversion: 2.1 time: 0.430371 Jun 29 11:32:25.558625 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 364/739] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:25 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1368 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:26.487308 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1303107712", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6647f91c-fe8e-4ab8-91a0-0e32da329b78"}], "security_groups": [{"name": "tempest-securitygroup--1684284649"}], "key_name": "tempest-keypair-945297564", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:26.507961 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:26.575974 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c22c8ea7-2c7f-4f95-9caa-4f44f3268869 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:26.576385 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c22c8ea7-2c7f-4f95-9caa-4f44f3268869 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:26.585054 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c22c8ea7-2c7f-4f95-9caa-4f44f3268869 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:26.585734 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c22c8ea7-2c7f-4f95-9caa-4f44f3268869 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:26.588171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c22c8ea7-2c7f-4f95-9caa-4f44f3268869 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:26.588765 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c22c8ea7-2c7f-4f95-9caa-4f44f3268869 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:26.718925 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] validate_networks() for [('6647f91c-fe8e-4ab8-91a0-0e32da329b78', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:32:26.924372 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c22c8ea7-2c7f-4f95-9caa-4f44f3268869 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:26.934838 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c22c8ea7-2c7f-4f95-9caa-4f44f3268869 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1368 microversion: 2.1 time: 0.364268 Jun 29 11:32:26.935546 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 365/740] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:26 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1368 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:26.940787 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-01d9b62c-0b01-4938-b0c6-a7e3f3374cb1 req-91958649-9508-4e9f-9c48-6b85f0c97ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00bf9bd8-c879-4105-8185-5390ce9d61aa", "tag": "b4466d29-fb33-463a-8b05-3045971a9d75"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:26.950121 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-01d9b62c-0b01-4938-b0c6-a7e3f3374cb1 req-91958649-9508-4e9f-9c48-6b85f0c97ca2 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:26.950732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-01d9b62c-0b01-4938-b0c6-a7e3f3374cb1 req-91958649-9508-4e9f-9c48-6b85f0c97ca2 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:26.962653 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-01d9b62c-0b01-4938-b0c6-a7e3f3374cb1 req-91958649-9508-4e9f-9c48-6b85f0c97ca2 service nova] Creating event network-changed:b4466d29-fb33-463a-8b05-3045971a9d75 for instance 00bf9bd8-c879-4105-8185-5390ce9d61aa on hv-cinder-84733 Jun 29 11:32:26.968815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-01d9b62c-0b01-4938-b0c6-a7e3f3374cb1 req-91958649-9508-4e9f-9c48-6b85f0c97ca2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031816 Jun 29 11:32:26.970273 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 366/741] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:27.266767 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:32:27.267515 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:32:27.268855 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:32:27.269515 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:32:27.270148 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:32:27.281525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:27.282374 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:27.284119 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:27.284812 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:27.310059 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Getting quotas for project 2c08a3d7e74f45999d1ba0ab11781458. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:32:27.315853 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Getting quotas for user f75e0b3528b14856b73dc441c52d1d73 and project 2c08a3d7e74f45999d1ba0ab11781458. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:32:27.328824 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:32:27.331479 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:32:27.530155 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a2f6bfe8-1ef5-4b0f-843d-9ad3990f78cf tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.048223 Jun 29 11:32:27.534530 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 376/742] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:32:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 11:32:27.545599 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ee8ce4f5-3d53-4590-aa29-abcd5fdbc13e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:27.546522 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ee8ce4f5-3d53-4590-aa29-abcd5fdbc13e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:27.632976 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ee8ce4f5-3d53-4590-aa29-abcd5fdbc13e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:27.642447 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ee8ce4f5-3d53-4590-aa29-abcd5fdbc13e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1237 microversion: 2.1 time: 0.101736 Jun 29 11:32:27.643277 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 367/743] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:27 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1237 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:27.952474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-759f1ae1-27dd-45d3-9207-807700790e04 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:27.953086 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-759f1ae1-27dd-45d3-9207-807700790e04 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:27.967310 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-759f1ae1-27dd-45d3-9207-807700790e04 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:27.967310 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-759f1ae1-27dd-45d3-9207-807700790e04 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:27.967310 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-759f1ae1-27dd-45d3-9207-807700790e04 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:27.967310 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-759f1ae1-27dd-45d3-9207-807700790e04 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:28.066974 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c001aee0-2c29-4d64-87e3-f49ca7abf757 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:28.067637 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c001aee0-2c29-4d64-87e3-f49ca7abf757 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:28.076588 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c001aee0-2c29-4d64-87e3-f49ca7abf757 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:28.078084 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c001aee0-2c29-4d64-87e3-f49ca7abf757 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:28.079235 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c001aee0-2c29-4d64-87e3-f49ca7abf757 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:28.079892 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c001aee0-2c29-4d64-87e3-f49ca7abf757 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:28.159487 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c001aee0-2c29-4d64-87e3-f49ca7abf757 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-volume_attachments/c6d12d93-eb44-4e33-bab7-3b94be9569eb" status: 200 len: 194 microversion: 2.20 time: 0.248857 Jun 29 11:32:28.165274 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 377/744] 10.222.0.44 () {60 vars in 1453 bytes} [Wed Jun 29 11:32:27 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-volume_attachments/c6d12d93-eb44-4e33-bab7-3b94be9569eb => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:32:28.248935 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-759f1ae1-27dd-45d3-9207-807700790e04 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:28.248935 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-759f1ae1-27dd-45d3-9207-807700790e04 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1368 microversion: 2.1 time: 0.297359 Jun 29 11:32:28.248935 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 368/745] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:27 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:28.249737 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4321e78d-0013-4b7d-aef4-071601a00011 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:28.250439 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4321e78d-0013-4b7d-aef4-071601a00011 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:28.257414 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4321e78d-0013-4b7d-aef4-071601a00011 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:28.258092 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4321e78d-0013-4b7d-aef4-071601a00011 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:28.259173 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4321e78d-0013-4b7d-aef4-071601a00011 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:28.259784 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4321e78d-0013-4b7d-aef4-071601a00011 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:28.341603 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:28.345453 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-4321e78d-0013-4b7d-aef4-071601a00011 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lazy-loading 'services' on Instance uuid bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:32:28.553106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4321e78d-0013-4b7d-aef4-071601a00011 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-volume_attachments/c6d12d93-eb44-4e33-bab7-3b94be9569eb" status: 202 len: 0 microversion: 2.20 time: 0.307424 Jun 29 11:32:28.557205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 378/746] 10.222.0.44 () {60 vars in 1456 bytes} [Wed Jun 29 11:32:28 2022] DELETE /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-volume_attachments/c6d12d93-eb44-4e33-bab7-3b94be9569eb => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 29 11:32:28.563653 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-34bf22bc-6187-49dd-a1e5-c9b0f3841db0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:28.564661 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-34bf22bc-6187-49dd-a1e5-c9b0f3841db0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:28.572315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34bf22bc-6187-49dd-a1e5-c9b0f3841db0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:28.572764 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34bf22bc-6187-49dd-a1e5-c9b0f3841db0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:28.574769 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34bf22bc-6187-49dd-a1e5-c9b0f3841db0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:28.578335 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34bf22bc-6187-49dd-a1e5-c9b0f3841db0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:28.608726 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-34bf22bc-6187-49dd-a1e5-c9b0f3841db0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050415 Jun 29 11:32:28.609277 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 369/747] 10.222.0.44 () {60 vars in 1342 bytes} [Wed Jun 29 11:32:28 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:32:28.662071 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-00d4e72d-5c55-4c61-a7db-55482edd975e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:28.663244 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00d4e72d-5c55-4c61-a7db-55482edd975e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:28.672167 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00d4e72d-5c55-4c61-a7db-55482edd975e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:28.672664 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00d4e72d-5c55-4c61-a7db-55482edd975e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:28.673840 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00d4e72d-5c55-4c61-a7db-55482edd975e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:28.674335 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00d4e72d-5c55-4c61-a7db-55482edd975e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:28.749519 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00d4e72d-5c55-4c61-a7db-55482edd975e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:28.757158 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-00d4e72d-5c55-4c61-a7db-55482edd975e tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1241 microversion: 2.1 time: 0.099678 Jun 29 11:32:28.766451 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 379/748] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:28 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:29.264296 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ea6631f7-fa58-4aaa-96f8-29803c15c1ca tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:29.264906 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ea6631f7-fa58-4aaa-96f8-29803c15c1ca tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:29.271180 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea6631f7-fa58-4aaa-96f8-29803c15c1ca tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:29.271854 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea6631f7-fa58-4aaa-96f8-29803c15c1ca tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:29.272787 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea6631f7-fa58-4aaa-96f8-29803c15c1ca tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:29.273408 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea6631f7-fa58-4aaa-96f8-29803c15c1ca tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:29.448222 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ea6631f7-fa58-4aaa-96f8-29803c15c1ca tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:29.456252 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ea6631f7-fa58-4aaa-96f8-29803c15c1ca tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1368 microversion: 2.1 time: 0.195810 Jun 29 11:32:29.456945 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 370/749] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:29 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:29.620725 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8b8a3b34-b632-418e-be41-32347d48fee8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:29.621720 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8b8a3b34-b632-418e-be41-32347d48fee8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:29.628559 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b8a3b34-b632-418e-be41-32347d48fee8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:29.629005 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b8a3b34-b632-418e-be41-32347d48fee8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:29.629759 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b8a3b34-b632-418e-be41-32347d48fee8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:29.630189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b8a3b34-b632-418e-be41-32347d48fee8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:29.663369 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8b8a3b34-b632-418e-be41-32347d48fee8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046614 Jun 29 11:32:29.663946 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 380/750] 10.222.0.44 () {60 vars in 1342 bytes} [Wed Jun 29 11:32:29 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:32:29.773784 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7f9c8b80-06d7-4660-b6eb-7eebd7551700 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:29.774575 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7f9c8b80-06d7-4660-b6eb-7eebd7551700 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:29.782669 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f9c8b80-06d7-4660-b6eb-7eebd7551700 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:29.783113 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f9c8b80-06d7-4660-b6eb-7eebd7551700 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:29.783925 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f9c8b80-06d7-4660-b6eb-7eebd7551700 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:29.784395 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f9c8b80-06d7-4660-b6eb-7eebd7551700 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:29.856896 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7f9c8b80-06d7-4660-b6eb-7eebd7551700 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:29.865889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7f9c8b80-06d7-4660-b6eb-7eebd7551700 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1289 microversion: 2.1 time: 0.096113 Jun 29 11:32:29.872177 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 371/751] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:29 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:30.153420 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-714d53d7-1662-4aac-a278-4918080d4644 req-28560d0e-1c2f-4879-a0b0-4a3eb63a2484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858", "name": "network-vif-plugged", "status": "completed", "tag": "2cf96133-2999-42a7-a7e8-23dae89812c7"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:30.168568 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-714d53d7-1662-4aac-a278-4918080d4644 req-28560d0e-1c2f-4879-a0b0-4a3eb63a2484 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:30.171956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-714d53d7-1662-4aac-a278-4918080d4644 req-28560d0e-1c2f-4879-a0b0-4a3eb63a2484 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:30.184810 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-714d53d7-1662-4aac-a278-4918080d4644 req-28560d0e-1c2f-4879-a0b0-4a3eb63a2484 service nova] Creating event network-vif-plugged:2cf96133-2999-42a7-a7e8-23dae89812c7 for instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 on hv-cinder-84733 Jun 29 11:32:30.190345 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-714d53d7-1662-4aac-a278-4918080d4644 req-28560d0e-1c2f-4879-a0b0-4a3eb63a2484 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042771 Jun 29 11:32:30.190958 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 381/752] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:30.473724 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5c42bfbe-fb37-4817-bf60-e4ab6a10731d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:30.474331 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5c42bfbe-fb37-4817-bf60-e4ab6a10731d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:30.481827 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c42bfbe-fb37-4817-bf60-e4ab6a10731d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:30.482277 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c42bfbe-fb37-4817-bf60-e4ab6a10731d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:30.483048 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c42bfbe-fb37-4817-bf60-e4ab6a10731d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:30.483486 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c42bfbe-fb37-4817-bf60-e4ab6a10731d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:30.657363 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5c42bfbe-fb37-4817-bf60-e4ab6a10731d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:30.664939 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5c42bfbe-fb37-4817-bf60-e4ab6a10731d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1368 microversion: 2.1 time: 0.195110 Jun 29 11:32:30.665627 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 372/753] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:30 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:30.675639 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-667d4934-86e1-49fe-9989-63e15dda0157 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:30.676704 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-667d4934-86e1-49fe-9989-63e15dda0157 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:30.684171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667d4934-86e1-49fe-9989-63e15dda0157 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:30.686529 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667d4934-86e1-49fe-9989-63e15dda0157 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:30.686529 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667d4934-86e1-49fe-9989-63e15dda0157 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:30.686529 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667d4934-86e1-49fe-9989-63e15dda0157 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:30.713698 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-667d4934-86e1-49fe-9989-63e15dda0157 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042510 Jun 29 11:32:30.714266 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 382/754] 10.222.0.44 () {60 vars in 1342 bytes} [Wed Jun 29 11:32:30 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:30.772160 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f3be1ab0-7bc8-48d5-abff-a67c3d23931c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:30.772659 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f3be1ab0-7bc8-48d5-abff-a67c3d23931c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:30.778555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3be1ab0-7bc8-48d5-abff-a67c3d23931c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:30.778996 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3be1ab0-7bc8-48d5-abff-a67c3d23931c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:30.779763 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3be1ab0-7bc8-48d5-abff-a67c3d23931c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:30.780214 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3be1ab0-7bc8-48d5-abff-a67c3d23931c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:30.805983 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f3be1ab0-7bc8-48d5-abff-a67c3d23931c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:32:30.834587 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:30.887313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e5d53df1-977b-4de0-89cc-99cd4195cf63 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:30.888057 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5d53df1-977b-4de0-89cc-99cd4195cf63 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:30.895743 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5d53df1-977b-4de0-89cc-99cd4195cf63 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:30.899731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5d53df1-977b-4de0-89cc-99cd4195cf63 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:30.899731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5d53df1-977b-4de0-89cc-99cd4195cf63 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:30.899731 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5d53df1-977b-4de0-89cc-99cd4195cf63 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:30.976161 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e5d53df1-977b-4de0-89cc-99cd4195cf63 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:30.984771 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e5d53df1-977b-4de0-89cc-99cd4195cf63 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1295 microversion: 2.1 time: 0.101439 Jun 29 11:32:30.989460 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 383/755] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:30 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1295 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:31.113611 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f3be1ab0-7bc8-48d5-abff-a67c3d23931c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 204 len: 0 microversion: 2.20 time: 0.344949 Jun 29 11:32:31.114423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 373/756] 10.222.0.44 () {60 vars in 1279 bytes} [Wed Jun 29 11:32:30 2022] DELETE /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 11:32:31.122604 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-53639aa8-377e-4900-98b3-cc8a6ee8078e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:31.123237 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-53639aa8-377e-4900-98b3-cc8a6ee8078e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:31.125407 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:31.130055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53639aa8-377e-4900-98b3-cc8a6ee8078e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:31.130496 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53639aa8-377e-4900-98b3-cc8a6ee8078e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:31.131250 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53639aa8-377e-4900-98b3-cc8a6ee8078e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:31.131770 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53639aa8-377e-4900-98b3-cc8a6ee8078e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:31.265622 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-53639aa8-377e-4900-98b3-cc8a6ee8078e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:31.273612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-53639aa8-377e-4900-98b3-cc8a6ee8078e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:31.275122 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-53639aa8-377e-4900-98b3-cc8a6ee8078e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:31.276344 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-53639aa8-377e-4900-98b3-cc8a6ee8078e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.157671 Jun 29 11:32:31.277417 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 384/757] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:31 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:31.683499 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9be396d0-e21b-4e3a-8ed2-76d6d3d313fb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:31.684917 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9be396d0-e21b-4e3a-8ed2-76d6d3d313fb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:31.695351 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9be396d0-e21b-4e3a-8ed2-76d6d3d313fb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:31.695985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9be396d0-e21b-4e3a-8ed2-76d6d3d313fb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:31.697165 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9be396d0-e21b-4e3a-8ed2-76d6d3d313fb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:31.698001 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9be396d0-e21b-4e3a-8ed2-76d6d3d313fb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:31.848613 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9be396d0-e21b-4e3a-8ed2-76d6d3d313fb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:31.856910 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9be396d0-e21b-4e3a-8ed2-76d6d3d313fb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1368 microversion: 2.1 time: 0.178358 Jun 29 11:32:31.857579 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 374/758] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:31 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:32.001891 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bff0f1e8-5a83-4fcd-8d6a-af81e165cddb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:32.002496 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bff0f1e8-5a83-4fcd-8d6a-af81e165cddb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:32.009315 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff0f1e8-5a83-4fcd-8d6a-af81e165cddb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:32.009757 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff0f1e8-5a83-4fcd-8d6a-af81e165cddb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:32.010509 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff0f1e8-5a83-4fcd-8d6a-af81e165cddb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:32.010936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff0f1e8-5a83-4fcd-8d6a-af81e165cddb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:32.141000 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bff0f1e8-5a83-4fcd-8d6a-af81e165cddb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:32.148652 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bff0f1e8-5a83-4fcd-8d6a-af81e165cddb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1363 microversion: 2.1 time: 0.150540 Jun 29 11:32:32.149312 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 385/759] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:31 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:32.295228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9b8737c5-1fdd-40a7-b0aa-e09d75368cb1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:32.295749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9b8737c5-1fdd-40a7-b0aa-e09d75368cb1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:32.302565 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b8737c5-1fdd-40a7-b0aa-e09d75368cb1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:32.303016 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b8737c5-1fdd-40a7-b0aa-e09d75368cb1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:32.303778 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b8737c5-1fdd-40a7-b0aa-e09d75368cb1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:32.304261 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b8737c5-1fdd-40a7-b0aa-e09d75368cb1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:32.442234 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9b8737c5-1fdd-40a7-b0aa-e09d75368cb1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:32.450719 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9b8737c5-1fdd-40a7-b0aa-e09d75368cb1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:32.452692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9b8737c5-1fdd-40a7-b0aa-e09d75368cb1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:32.454141 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9b8737c5-1fdd-40a7-b0aa-e09d75368cb1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.163549 Jun 29 11:32:32.454934 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 375/760] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:32 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:32.874218 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-755e1703-7cfb-4736-b630-f58b6f6f2cd6 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:32.874948 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-755e1703-7cfb-4736-b630-f58b6f6f2cd6 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:32.881459 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-755e1703-7cfb-4736-b630-f58b6f6f2cd6 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:32.881850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-755e1703-7cfb-4736-b630-f58b6f6f2cd6 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:32.882615 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-755e1703-7cfb-4736-b630-f58b6f6f2cd6 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:32.883059 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-755e1703-7cfb-4736-b630-f58b6f6f2cd6 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:33.068455 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-755e1703-7cfb-4736-b630-f58b6f6f2cd6 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:33.078630 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-755e1703-7cfb-4736-b630-f58b6f6f2cd6 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1368 microversion: 2.1 time: 0.208256 Jun 29 11:32:33.079321 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 386/761] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:32 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:33.167022 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e803d654-43b0-46c6-9443-b7c55c81e802 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:33.168933 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e803d654-43b0-46c6-9443-b7c55c81e802 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:33.178020 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e803d654-43b0-46c6-9443-b7c55c81e802 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:33.178603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e803d654-43b0-46c6-9443-b7c55c81e802 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:33.179515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e803d654-43b0-46c6-9443-b7c55c81e802 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:33.180081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e803d654-43b0-46c6-9443-b7c55c81e802 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:33.414809 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e803d654-43b0-46c6-9443-b7c55c81e802 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:33.424706 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e803d654-43b0-46c6-9443-b7c55c81e802 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1363 microversion: 2.1 time: 0.262420 Jun 29 11:32:33.425784 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 376/762] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:33 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:33.473871 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bea97634-c3f6-466f-b969-fed7d1509473 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:33.475768 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bea97634-c3f6-466f-b969-fed7d1509473 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:33.481429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bea97634-c3f6-466f-b969-fed7d1509473 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:33.481875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bea97634-c3f6-466f-b969-fed7d1509473 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:33.483226 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bea97634-c3f6-466f-b969-fed7d1509473 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:33.483780 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bea97634-c3f6-466f-b969-fed7d1509473 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:33.752679 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bea97634-c3f6-466f-b969-fed7d1509473 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:33.768326 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bea97634-c3f6-466f-b969-fed7d1509473 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:33.770348 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bea97634-c3f6-466f-b969-fed7d1509473 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:33.773239 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bea97634-c3f6-466f-b969-fed7d1509473 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.302031 Jun 29 11:32:33.775033 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 387/763] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:33 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:34.019087 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-67f6b458-1576-4ad4-b2e8-7a566546c7cf req-b8bac669-deab-4430-9da3-6eef0f1b5ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0579c0-af58-4d2d-8083-2ef8eaad4f6e", "tag": "3c962a59-c58e-4bdb-8951-1fd2bc37814e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:34.042773 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-67f6b458-1576-4ad4-b2e8-7a566546c7cf req-b8bac669-deab-4430-9da3-6eef0f1b5ae5 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:34.056695 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-67f6b458-1576-4ad4-b2e8-7a566546c7cf req-b8bac669-deab-4430-9da3-6eef0f1b5ae5 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:34.063483 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-67f6b458-1576-4ad4-b2e8-7a566546c7cf req-b8bac669-deab-4430-9da3-6eef0f1b5ae5 service nova] Creating event network-changed:3c962a59-c58e-4bdb-8951-1fd2bc37814e for instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e on hv-cinder-84733 Jun 29 11:32:34.081662 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-67f6b458-1576-4ad4-b2e8-7a566546c7cf req-b8bac669-deab-4430-9da3-6eef0f1b5ae5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074352 Jun 29 11:32:34.082846 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 377/764] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:34.096534 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ef05b42b-52a9-43ea-99ff-a5a5d67d843d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:34.097892 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ef05b42b-52a9-43ea-99ff-a5a5d67d843d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:34.106927 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef05b42b-52a9-43ea-99ff-a5a5d67d843d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:34.107579 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef05b42b-52a9-43ea-99ff-a5a5d67d843d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:34.108901 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef05b42b-52a9-43ea-99ff-a5a5d67d843d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:34.109518 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef05b42b-52a9-43ea-99ff-a5a5d67d843d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:34.442195 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c93e65a8-a251-4f1d-9440-11b0fcfbdf23 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:34.443555 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c93e65a8-a251-4f1d-9440-11b0fcfbdf23 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:34.450997 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c93e65a8-a251-4f1d-9440-11b0fcfbdf23 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:34.452458 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c93e65a8-a251-4f1d-9440-11b0fcfbdf23 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:34.452593 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c93e65a8-a251-4f1d-9440-11b0fcfbdf23 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:34.453148 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c93e65a8-a251-4f1d-9440-11b0fcfbdf23 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:34.724561 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ef05b42b-52a9-43ea-99ff-a5a5d67d843d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:34.734006 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ef05b42b-52a9-43ea-99ff-a5a5d67d843d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1558 microversion: 2.1 time: 0.642643 Jun 29 11:32:34.734835 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 388/765] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:34 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1558 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:34.751366 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7c57a6d8-e587-4f11-880e-c57af78eb36e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:34.752162 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7c57a6d8-e587-4f11-880e-c57af78eb36e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:34.758292 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c57a6d8-e587-4f11-880e-c57af78eb36e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:34.758740 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c57a6d8-e587-4f11-880e-c57af78eb36e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:34.759552 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c57a6d8-e587-4f11-880e-c57af78eb36e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:34.760048 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c57a6d8-e587-4f11-880e-c57af78eb36e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:34.869074 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c93e65a8-a251-4f1d-9440-11b0fcfbdf23 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:34.879902 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c93e65a8-a251-4f1d-9440-11b0fcfbdf23 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1363 microversion: 2.1 time: 0.441705 Jun 29 11:32:34.892430 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 378/766] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:34 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1363 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:34.898216 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fc300bec-fb93-417d-9a51-791e62e1bed3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:34.898977 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fc300bec-fb93-417d-9a51-791e62e1bed3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:34.905758 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc300bec-fb93-417d-9a51-791e62e1bed3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:34.906513 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc300bec-fb93-417d-9a51-791e62e1bed3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:34.907330 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc300bec-fb93-417d-9a51-791e62e1bed3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:34.908164 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc300bec-fb93-417d-9a51-791e62e1bed3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:34.973003 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7c57a6d8-e587-4f11-880e-c57af78eb36e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.225407 Jun 29 11:32:34.973681 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 389/767] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jun 29 11:32:34 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:32:35.242986 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fc300bec-fb93-417d-9a51-791e62e1bed3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:35.251889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fc300bec-fb93-417d-9a51-791e62e1bed3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:35.257745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fc300bec-fb93-417d-9a51-791e62e1bed3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:35.257745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fc300bec-fb93-417d-9a51-791e62e1bed3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1724 microversion: 2.20 time: 0.360846 Jun 29 11:32:35.257745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 379/768] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:34 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1724 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:35.796156 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-e66adb9e-7f46-4660-81da-1c0857bfb323 req-98e43b93-618c-449e-bc2a-7c229991a8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde34fdf-bfe6-48a4-9b9e-95ff879ffa70", "name": "network-vif-deleted", "tag": "dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:35.804662 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e66adb9e-7f46-4660-81da-1c0857bfb323 req-98e43b93-618c-449e-bc2a-7c229991a8af service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:35.805344 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e66adb9e-7f46-4660-81da-1c0857bfb323 req-98e43b93-618c-449e-bc2a-7c229991a8af service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:35.818060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-e66adb9e-7f46-4660-81da-1c0857bfb323 req-98e43b93-618c-449e-bc2a-7c229991a8af service nova] Creating event network-vif-deleted:dbb6ba4b-552f-4bcc-8ae5-f703b3b32f48 for instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 on hv-cinder-84733 Jun 29 11:32:35.825974 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-e66adb9e-7f46-4660-81da-1c0857bfb323 req-98e43b93-618c-449e-bc2a-7c229991a8af service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031690 Jun 29 11:32:35.828377 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 390/769] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:35.901289 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b04119c2-8b31-4310-a743-123e34a92352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:35.902535 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b04119c2-8b31-4310-a743-123e34a92352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:35.911629 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b04119c2-8b31-4310-a743-123e34a92352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:35.911629 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b04119c2-8b31-4310-a743-123e34a92352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:35.912652 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b04119c2-8b31-4310-a743-123e34a92352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:35.913322 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b04119c2-8b31-4310-a743-123e34a92352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:36.133628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b04119c2-8b31-4310-a743-123e34a92352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:36.141844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b04119c2-8b31-4310-a743-123e34a92352 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1363 microversion: 2.1 time: 0.245037 Jun 29 11:32:36.151361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 380/770] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:35 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:36.276430 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2fa1bb57-80ee-4b18-ae57-cd83baaaed7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:36.278116 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2fa1bb57-80ee-4b18-ae57-cd83baaaed7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:36.288876 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fa1bb57-80ee-4b18-ae57-cd83baaaed7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:36.290830 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fa1bb57-80ee-4b18-ae57-cd83baaaed7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:36.293284 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fa1bb57-80ee-4b18-ae57-cd83baaaed7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:36.293815 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fa1bb57-80ee-4b18-ae57-cd83baaaed7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:36.399411 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-302c8b4e-e66c-4081-ae47-b4071390d474 req-033a991e-7f1f-4100-a1f3-ad62bff76797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858", "tag": "2cf96133-2999-42a7-a7e8-23dae89812c7"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:36.401065 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2fa1bb57-80ee-4b18-ae57-cd83baaaed7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:36.410562 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2fa1bb57-80ee-4b18-ae57-cd83baaaed7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:36.411819 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2fa1bb57-80ee-4b18-ae57-cd83baaaed7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:36.413021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2fa1bb57-80ee-4b18-ae57-cd83baaaed7b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1657 microversion: 2.20 time: 0.142786 Jun 29 11:32:36.413708 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-302c8b4e-e66c-4081-ae47-b4071390d474 req-033a991e-7f1f-4100-a1f3-ad62bff76797 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:36.418285 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-302c8b4e-e66c-4081-ae47-b4071390d474 req-033a991e-7f1f-4100-a1f3-ad62bff76797 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:36.420886 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 391/771] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:36 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1657 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:36.436012 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-302c8b4e-e66c-4081-ae47-b4071390d474 req-033a991e-7f1f-4100-a1f3-ad62bff76797 service nova] Creating event network-changed:2cf96133-2999-42a7-a7e8-23dae89812c7 for instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 on hv-cinder-84733 Jun 29 11:32:36.441286 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-302c8b4e-e66c-4081-ae47-b4071390d474 req-033a991e-7f1f-4100-a1f3-ad62bff76797 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045945 Jun 29 11:32:36.442172 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 381/772] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:32:37.158740 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7c63cabd-007e-476e-a27e-11b9504b9429 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:37.160087 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7c63cabd-007e-476e-a27e-11b9504b9429 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:37.173107 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c63cabd-007e-476e-a27e-11b9504b9429 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:37.173668 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c63cabd-007e-476e-a27e-11b9504b9429 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:37.174601 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c63cabd-007e-476e-a27e-11b9504b9429 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:37.175286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7c63cabd-007e-476e-a27e-11b9504b9429 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:37.301151 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:37.323548 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:37.432753 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:37.434194 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:37.440341 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7c63cabd-007e-476e-a27e-11b9504b9429 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:37.441290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:37.441841 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:37.442749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:37.443282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:37.454619 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7c63cabd-007e-476e-a27e-11b9504b9429 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1363 microversion: 2.1 time: 0.299601 Jun 29 11:32:37.455208 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 392/773] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:37 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:37.485121 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:37.485534 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:37.486177 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lazy-loading 'fault' on Instance uuid bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:32:37.530149 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:37.538378 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:37.542582 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:37.542582 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-612fc623-94ec-4270-b871-69b11b94370a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 200 len: 1372 microversion: 2.20 time: 0.113307 Jun 29 11:32:37.542582 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 382/774] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:37 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:38.471655 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-204a61de-1295-4ccd-bfb9-9343dc1eb999 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:38.472300 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-204a61de-1295-4ccd-bfb9-9343dc1eb999 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:38.479242 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-204a61de-1295-4ccd-bfb9-9343dc1eb999 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:38.481933 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-204a61de-1295-4ccd-bfb9-9343dc1eb999 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:38.481933 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-204a61de-1295-4ccd-bfb9-9343dc1eb999 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:38.481933 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-204a61de-1295-4ccd-bfb9-9343dc1eb999 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:38.559940 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-db6e8473-4898-4ee6-98ff-d3324802e6d4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:38.560615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-db6e8473-4898-4ee6-98ff-d3324802e6d4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:38.562848 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=18 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:38.568610 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db6e8473-4898-4ee6-98ff-d3324802e6d4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:38.569109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db6e8473-4898-4ee6-98ff-d3324802e6d4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:38.569820 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db6e8473-4898-4ee6-98ff-d3324802e6d4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:38.570250 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db6e8473-4898-4ee6-98ff-d3324802e6d4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:38.585957 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-db6e8473-4898-4ee6-98ff-d3324802e6d4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] HTTP exception thrown: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-db6e8473-4898-4ee6-98ff-d3324802e6d4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Request method failure captured: Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 HTTP/1.1 Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDcJtqXZgTA5bnAtNLAViYu8KzbirrJvshhtBHvnHgq6za50BpQcslYYakTA3-uP91chtsP_XKm95_9nU3EV4CLN90PURAN-_0uEJKrmAX-2ThVGQOPDhdZZpK7YmkmmJBpGCjcuu1WY2HT6WVGtUjp6Sc_xl8eXENID5Ioj39zHAnU Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 364a7eaf772c434e9e38a18430425895 Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:32:38.588031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:32:38.590349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/364a7eaf772c434e9e38a18430425895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_364a7eaf772c434e9e38a18430425895", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/364a7eaf772c434e9e38a18430425895"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/364a7eaf772c434e9e38a18430425895"}]}] Jun 29 11:32:38.590349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:32:38.590349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 364a7eaf772c434e9e38a18430425895 Jun 29 11:32:38.590349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:32:38.590349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeShelveTestJSON-499333534-project Jun 29 11:32:38.590349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:32:38.590349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:32:38.590349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 275df17696084dce9e7af487275bacab Jun 29 11:32:38.590349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-499333534-project Jun 29 11:32:38.590349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:32:38.590349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:32:38.590349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': 'bde34fdf-bfe6-48a4-9b9e-95ff879ffa70'} Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:32:38.591282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:32:38.592554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:32:38.593640 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-db6e8473-4898-4ee6-98ff-d3324802e6d4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Returning 404 to user: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:32:38.593640 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-db6e8473-4898-4ee6-98ff-d3324802e6d4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 404 len: 111 microversion: 2.20 time: 0.034159 Jun 29 11:32:38.593640 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 383/775] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:38 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 11:32:38.599026 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2bf8c3a8-4d7b-4d6c-8524-f8b858dbc283 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '.version_select at 0x7fd0895498b0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:38.630901 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-204a61de-1295-4ccd-bfb9-9343dc1eb999 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:38.638676 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-204a61de-1295-4ccd-bfb9-9343dc1eb999 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1363 microversion: 2.1 time: 0.170973 Jun 29 11:32:38.639242 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 393/776] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:38 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:38.669284 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2bf8c3a8-4d7b-4d6c-8524-f8b858dbc283 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667801896" status: 204 len: 0 microversion: 2.20 time: 0.074003 Jun 29 11:32:38.669862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 384/777] 10.222.0.44 () {60 vars in 1261 bytes} [Wed Jun 29 11:32:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667801896 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 29 11:32:39.415640 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d8513c07-3cd3-473e-9c1f-54b4b9d23206 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Action: 'create', calling method: .version_select at 0x7fd089486af0>, body: {"keypair": {"name": "tempest-keypair-1384864845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/3ESosQRBi7mTjrTBOMq98LeCwsQI8NFIhnUcFQTJK4OsLAyCj1fhM1j8lH2B6QhzEkPrxCWfDzIUE1L9bjZBdDdA+qXldcWV4DdkHSJtltdlZmAqXo8/75z3yKgxtcg=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:39.429618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d8513c07-3cd3-473e-9c1f-54b4b9d23206 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Getting quotas for project 364a7eaf772c434e9e38a18430425895. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:32:39.433363 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d8513c07-3cd3-473e-9c1f-54b4b9d23206 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Getting quotas for user 275df17696084dce9e7af487275bacab and project 364a7eaf772c434e9e38a18430425895. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:32:39.508307 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d8513c07-3cd3-473e-9c1f-54b4b9d23206 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.096577 Jun 29 11:32:39.508931 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 394/778] 10.222.0.44 () {62 vars in 1199 bytes} [Wed Jun 29 11:32:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 29 11:32:39.656543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dbbe59c2-8a5f-4365-845f-d7e6cc3ed5eb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:39.657192 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dbbe59c2-8a5f-4365-845f-d7e6cc3ed5eb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:39.664141 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbbe59c2-8a5f-4365-845f-d7e6cc3ed5eb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:39.670431 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbbe59c2-8a5f-4365-845f-d7e6cc3ed5eb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:39.670431 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbbe59c2-8a5f-4365-845f-d7e6cc3ed5eb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:39.670431 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbbe59c2-8a5f-4365-845f-d7e6cc3ed5eb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:39.798238 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dbbe59c2-8a5f-4365-845f-d7e6cc3ed5eb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:39.805866 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dbbe59c2-8a5f-4365-845f-d7e6cc3ed5eb tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1363 microversion: 2.1 time: 0.154469 Jun 29 11:32:39.806445 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 385/779] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:39 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:40.822725 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d9932d65-f203-4069-ada8-297f763d940d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:40.824182 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d9932d65-f203-4069-ada8-297f763d940d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:40.830765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9932d65-f203-4069-ada8-297f763d940d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:40.831236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9932d65-f203-4069-ada8-297f763d940d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:40.832044 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9932d65-f203-4069-ada8-297f763d940d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:40.832491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9932d65-f203-4069-ada8-297f763d940d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:40.967797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d9932d65-f203-4069-ada8-297f763d940d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:40.976944 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d9932d65-f203-4069-ada8-297f763d940d tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1363 microversion: 2.1 time: 0.157499 Jun 29 11:32:40.977126 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 395/780] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:40 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:41.547341 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-638286951", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e08f0a4-ae33-4a05-b770-16cb5680655c"}], "security_groups": [{"name": "tempest-securitygroup--1105794130"}], "key_name": "tempest-keypair-1384864845", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:41.647569 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] validate_networks() for [('6e08f0a4-ae33-4a05-b770-16cb5680655c', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:32:41.993286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ade4e2eb-f909-47c5-8589-6d1917fc915f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:41.993908 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ade4e2eb-f909-47c5-8589-6d1917fc915f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:42.000396 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ade4e2eb-f909-47c5-8589-6d1917fc915f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:42.000853 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ade4e2eb-f909-47c5-8589-6d1917fc915f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:42.001622 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ade4e2eb-f909-47c5-8589-6d1917fc915f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:42.002268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ade4e2eb-f909-47c5-8589-6d1917fc915f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:42.018268 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:32:42.018687 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:32:42.019149 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:32:42.019544 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:32:42.019978 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:32:42.030634 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:42.031455 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:42.032375 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:42.032995 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:42.052566 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Getting quotas for project 364a7eaf772c434e9e38a18430425895. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:32:42.056774 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Getting quotas for user 275df17696084dce9e7af487275bacab and project 364a7eaf772c434e9e38a18430425895. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:32:42.071696 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:32:42.074058 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:32:42.139791 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ade4e2eb-f909-47c5-8589-6d1917fc915f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:42.147304 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ade4e2eb-f909-47c5-8589-6d1917fc915f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1363 microversion: 2.1 time: 0.157893 Jun 29 11:32:42.147931 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 396/781] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:41 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:32:42.191263 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eb70002e-71df-49ea-99cd-e542cf7de7ff tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.648772 Jun 29 11:32:42.192206 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 386/782] 10.222.0.44 () {62 vars in 1187 bytes} [Wed Jun 29 11:32:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 29 11:32:42.193204 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-fc1f6ccc-df51-4c32-8b4e-87cceb9117ab req-c36ebdd4-a5f2-476e-94c9-0695561f4bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0579c0-af58-4d2d-8083-2ef8eaad4f6e", "name": "network-vif-plugged", "status": "completed", "tag": "3c962a59-c58e-4bdb-8951-1fd2bc37814e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:42.201794 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fc1f6ccc-df51-4c32-8b4e-87cceb9117ab req-c36ebdd4-a5f2-476e-94c9-0695561f4bb1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:42.202240 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fc1f6ccc-df51-4c32-8b4e-87cceb9117ab req-c36ebdd4-a5f2-476e-94c9-0695561f4bb1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:42.203321 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e0fe5397-fda7-4c2b-930b-de03817d6aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:42.206354 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e0fe5397-fda7-4c2b-930b-de03817d6aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:42.213331 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-fc1f6ccc-df51-4c32-8b4e-87cceb9117ab req-c36ebdd4-a5f2-476e-94c9-0695561f4bb1 service nova] Creating event network-vif-plugged:3c962a59-c58e-4bdb-8951-1fd2bc37814e for instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e on hv-cinder-84733 Jun 29 11:32:42.220065 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-fc1f6ccc-df51-4c32-8b4e-87cceb9117ab req-c36ebdd4-a5f2-476e-94c9-0695561f4bb1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030342 Jun 29 11:32:42.220616 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 397/783] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:32:42.278375 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e0fe5397-fda7-4c2b-930b-de03817d6aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:42.288221 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e0fe5397-fda7-4c2b-930b-de03817d6aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:42.289848 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e0fe5397-fda7-4c2b-930b-de03817d6aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:42.290998 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e0fe5397-fda7-4c2b-930b-de03817d6aa8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1281 microversion: 2.20 time: 0.092196 Jun 29 11:32:42.291515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 387/784] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:42 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:32:43.164335 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6337789c-2111-4cc5-8844-4b74072ae68f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:43.165035 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6337789c-2111-4cc5-8844-4b74072ae68f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:43.171978 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6337789c-2111-4cc5-8844-4b74072ae68f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:43.172429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6337789c-2111-4cc5-8844-4b74072ae68f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:43.173192 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6337789c-2111-4cc5-8844-4b74072ae68f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:43.173650 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6337789c-2111-4cc5-8844-4b74072ae68f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:43.177787 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:43.302537 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6337789c-2111-4cc5-8844-4b74072ae68f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:43.309994 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6337789c-2111-4cc5-8844-4b74072ae68f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1363 microversion: 2.1 time: 0.150293 Jun 29 11:32:43.310548 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 398/785] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:43 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:43.311390 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-da223e7e-d93e-4db9-96c6-dcf247855d87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:43.312070 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-da223e7e-d93e-4db9-96c6-dcf247855d87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:43.318904 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da223e7e-d93e-4db9-96c6-dcf247855d87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:43.319356 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da223e7e-d93e-4db9-96c6-dcf247855d87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:43.320155 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da223e7e-d93e-4db9-96c6-dcf247855d87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:43.320597 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da223e7e-d93e-4db9-96c6-dcf247855d87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:43.385543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-da223e7e-d93e-4db9-96c6-dcf247855d87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:43.393979 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-da223e7e-d93e-4db9-96c6-dcf247855d87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:43.398596 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-da223e7e-d93e-4db9-96c6-dcf247855d87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:43.398596 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-da223e7e-d93e-4db9-96c6-dcf247855d87 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1285 microversion: 2.20 time: 0.089098 Jun 29 11:32:43.398596 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 388/786] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:43 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:32:44.326349 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5025ee9c-e42e-4cbd-9778-cca6b1c58a44 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:44.326970 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5025ee9c-e42e-4cbd-9778-cca6b1c58a44 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:44.333664 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5025ee9c-e42e-4cbd-9778-cca6b1c58a44 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:44.334149 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5025ee9c-e42e-4cbd-9778-cca6b1c58a44 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:44.334917 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5025ee9c-e42e-4cbd-9778-cca6b1c58a44 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:44.335355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5025ee9c-e42e-4cbd-9778-cca6b1c58a44 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:44.414670 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-44a04e8b-be81-44ba-b305-89a9e11603f2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:44.415331 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-44a04e8b-be81-44ba-b305-89a9e11603f2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:44.422429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44a04e8b-be81-44ba-b305-89a9e11603f2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:44.422877 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44a04e8b-be81-44ba-b305-89a9e11603f2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:44.423691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44a04e8b-be81-44ba-b305-89a9e11603f2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:44.424151 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-44a04e8b-be81-44ba-b305-89a9e11603f2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:44.474358 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5025ee9c-e42e-4cbd-9778-cca6b1c58a44 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:44.482719 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5025ee9c-e42e-4cbd-9778-cca6b1c58a44 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1363 microversion: 2.1 time: 0.160288 Jun 29 11:32:44.483293 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 399/787] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:44 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:44.490439 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-44a04e8b-be81-44ba-b305-89a9e11603f2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:44.498232 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-44a04e8b-be81-44ba-b305-89a9e11603f2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:44.499731 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-44a04e8b-be81-44ba-b305-89a9e11603f2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:44.500844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-44a04e8b-be81-44ba-b305-89a9e11603f2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1333 microversion: 2.20 time: 0.090235 Jun 29 11:32:44.501389 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 389/788] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:44 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:32:45.499653 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-de1061ee-c2f6-4443-91f6-8cf65abfde5f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:45.500305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-de1061ee-c2f6-4443-91f6-8cf65abfde5f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:45.506791 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de1061ee-c2f6-4443-91f6-8cf65abfde5f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:45.507242 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de1061ee-c2f6-4443-91f6-8cf65abfde5f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:45.508023 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de1061ee-c2f6-4443-91f6-8cf65abfde5f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:45.508459 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de1061ee-c2f6-4443-91f6-8cf65abfde5f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:45.518482 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-358216e2-3aff-4f86-bcae-dec08b21944a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:45.519101 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-358216e2-3aff-4f86-bcae-dec08b21944a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:45.525912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-358216e2-3aff-4f86-bcae-dec08b21944a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:45.526364 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-358216e2-3aff-4f86-bcae-dec08b21944a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:45.527221 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-358216e2-3aff-4f86-bcae-dec08b21944a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:45.527771 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-358216e2-3aff-4f86-bcae-dec08b21944a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:45.650693 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-358216e2-3aff-4f86-bcae-dec08b21944a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:45.659502 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-358216e2-3aff-4f86-bcae-dec08b21944a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:45.661054 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-358216e2-3aff-4f86-bcae-dec08b21944a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:45.662334 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-358216e2-3aff-4f86-bcae-dec08b21944a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1341 microversion: 2.20 time: 0.147514 Jun 29 11:32:45.662751 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 390/789] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:45 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1341 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:32:45.757842 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-de1061ee-c2f6-4443-91f6-8cf65abfde5f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:45.765955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-de1061ee-c2f6-4443-91f6-8cf65abfde5f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1549 microversion: 2.1 time: 0.270277 Jun 29 11:32:45.768156 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 400/790] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:32:45 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1549 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:32:45.783006 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-64d84474-0891-4515-ad09-1379f585baf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:45.783504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-64d84474-0891-4515-ad09-1379f585baf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:45.789882 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-64d84474-0891-4515-ad09-1379f585baf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:45.790340 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-64d84474-0891-4515-ad09-1379f585baf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:45.794141 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-64d84474-0891-4515-ad09-1379f585baf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:45.794141 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-64d84474-0891-4515-ad09-1379f585baf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:46.145189 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-64d84474-0891-4515-ad09-1379f585baf1 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.366834 Jun 29 11:32:46.145815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 391/791] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jun 29 11:32:45 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-interface => generated 284 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:46.681335 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-17d252b4-5d4a-4ab7-98a5-98ae1505f1d8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:46.682072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-17d252b4-5d4a-4ab7-98a5-98ae1505f1d8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:46.692370 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17d252b4-5d4a-4ab7-98a5-98ae1505f1d8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:46.692814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17d252b4-5d4a-4ab7-98a5-98ae1505f1d8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:46.693701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17d252b4-5d4a-4ab7-98a5-98ae1505f1d8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:46.694130 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17d252b4-5d4a-4ab7-98a5-98ae1505f1d8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:46.863168 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-17d252b4-5d4a-4ab7-98a5-98ae1505f1d8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:46.871626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-17d252b4-5d4a-4ab7-98a5-98ae1505f1d8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:46.873266 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-17d252b4-5d4a-4ab7-98a5-98ae1505f1d8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:46.874412 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-17d252b4-5d4a-4ab7-98a5-98ae1505f1d8 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1407 microversion: 2.20 time: 0.198188 Jun 29 11:32:46.875054 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 401/792] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:46 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:47.200804 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-c32691f7-0e6a-498e-8311-92b1a49275fa req-9e621775-16a8-4b21-9dd2-ebed33aae6fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0579c0-af58-4d2d-8083-2ef8eaad4f6e", "tag": "3c962a59-c58e-4bdb-8951-1fd2bc37814e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:47.210048 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c32691f7-0e6a-498e-8311-92b1a49275fa req-9e621775-16a8-4b21-9dd2-ebed33aae6fb service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:47.210593 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c32691f7-0e6a-498e-8311-92b1a49275fa req-9e621775-16a8-4b21-9dd2-ebed33aae6fb service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:47.222740 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-c32691f7-0e6a-498e-8311-92b1a49275fa req-9e621775-16a8-4b21-9dd2-ebed33aae6fb service nova] Creating event network-changed:3c962a59-c58e-4bdb-8951-1fd2bc37814e for instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e on hv-cinder-84733 Jun 29 11:32:47.228600 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-c32691f7-0e6a-498e-8311-92b1a49275fa req-9e621775-16a8-4b21-9dd2-ebed33aae6fb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032360 Jun 29 11:32:47.229842 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 392/793] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:32:47.733278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-55398bd1-3d04-4f07-8fde-37769442df87 req-bfebbd5c-dca5-4d79-b82d-0e9b3cd82a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4d9da5-e4b3-407e-9b1d-4a33a8829015", "tag": "85554f15-efa6-4d62-91fa-d1490f006424"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:47.758049 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-55398bd1-3d04-4f07-8fde-37769442df87 req-bfebbd5c-dca5-4d79-b82d-0e9b3cd82a05 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:47.759533 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-55398bd1-3d04-4f07-8fde-37769442df87 req-bfebbd5c-dca5-4d79-b82d-0e9b3cd82a05 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:47.772646 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-55398bd1-3d04-4f07-8fde-37769442df87 req-bfebbd5c-dca5-4d79-b82d-0e9b3cd82a05 service nova] Creating event network-changed:85554f15-efa6-4d62-91fa-d1490f006424 for instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 on hv-cinder-84733 Jun 29 11:32:47.778429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-55398bd1-3d04-4f07-8fde-37769442df87 req-bfebbd5c-dca5-4d79-b82d-0e9b3cd82a05 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061942 Jun 29 11:32:47.782374 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 402/794] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:32:47.894528 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a255529d-dc22-46c2-8ad5-870d5a33f4a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:47.895325 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a255529d-dc22-46c2-8ad5-870d5a33f4a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:47.908214 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a255529d-dc22-46c2-8ad5-870d5a33f4a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:47.911009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a255529d-dc22-46c2-8ad5-870d5a33f4a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:47.911865 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a255529d-dc22-46c2-8ad5-870d5a33f4a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:47.912304 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a255529d-dc22-46c2-8ad5-870d5a33f4a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:48.142760 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a255529d-dc22-46c2-8ad5-870d5a33f4a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:48.153048 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a255529d-dc22-46c2-8ad5-870d5a33f4a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:48.154797 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a255529d-dc22-46c2-8ad5-870d5a33f4a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:48.156379 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a255529d-dc22-46c2-8ad5-870d5a33f4a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1407 microversion: 2.20 time: 0.266953 Jun 29 11:32:48.157136 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 393/795] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:47 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:49.175503 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-364c0eb0-e39e-45a1-bc80-09a97470e725 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:49.176120 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-364c0eb0-e39e-45a1-bc80-09a97470e725 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:49.182359 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-364c0eb0-e39e-45a1-bc80-09a97470e725 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:49.182797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-364c0eb0-e39e-45a1-bc80-09a97470e725 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:49.183544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-364c0eb0-e39e-45a1-bc80-09a97470e725 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:49.184003 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-364c0eb0-e39e-45a1-bc80-09a97470e725 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:49.312817 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-364c0eb0-e39e-45a1-bc80-09a97470e725 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:49.320516 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-364c0eb0-e39e-45a1-bc80-09a97470e725 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:49.322003 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-364c0eb0-e39e-45a1-bc80-09a97470e725 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:49.323087 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-364c0eb0-e39e-45a1-bc80-09a97470e725 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1407 microversion: 2.20 time: 0.152474 Jun 29 11:32:49.323637 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 403/796] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:49 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:50.340785 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8cc8aa7e-6545-4f6e-85c0-398d3baeba54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:50.342276 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8cc8aa7e-6545-4f6e-85c0-398d3baeba54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:50.348044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8cc8aa7e-6545-4f6e-85c0-398d3baeba54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:50.348491 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8cc8aa7e-6545-4f6e-85c0-398d3baeba54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:50.349423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8cc8aa7e-6545-4f6e-85c0-398d3baeba54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:50.349733 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8cc8aa7e-6545-4f6e-85c0-398d3baeba54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:50.477505 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8cc8aa7e-6545-4f6e-85c0-398d3baeba54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:50.481222 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:50.486546 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8cc8aa7e-6545-4f6e-85c0-398d3baeba54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:50.488094 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8cc8aa7e-6545-4f6e-85c0-398d3baeba54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:50.489168 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8cc8aa7e-6545-4f6e-85c0-398d3baeba54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1407 microversion: 2.20 time: 0.152329 Jun 29 11:32:50.494263 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 394/797] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:50 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:51.506575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0c1a60ec-ff6f-4164-9bb3-b079e3a02ef2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:51.507177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0c1a60ec-ff6f-4164-9bb3-b079e3a02ef2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:51.509114 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:51.515030 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c1a60ec-ff6f-4164-9bb3-b079e3a02ef2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:51.515471 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c1a60ec-ff6f-4164-9bb3-b079e3a02ef2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:51.516251 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c1a60ec-ff6f-4164-9bb3-b079e3a02ef2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:51.516681 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c1a60ec-ff6f-4164-9bb3-b079e3a02ef2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:51.649596 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c1a60ec-ff6f-4164-9bb3-b079e3a02ef2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:51.657593 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c1a60ec-ff6f-4164-9bb3-b079e3a02ef2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:51.659113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c1a60ec-ff6f-4164-9bb3-b079e3a02ef2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:51.660420 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0c1a60ec-ff6f-4164-9bb3-b079e3a02ef2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1407 microversion: 2.20 time: 0.157755 Jun 29 11:32:51.660971 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 404/798] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:51 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:52.678807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7901d82e-b938-4ceb-9100-60a58367f4f4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:52.679398 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7901d82e-b938-4ceb-9100-60a58367f4f4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:52.681710 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:52.682360 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=8 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:52.688017 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7901d82e-b938-4ceb-9100-60a58367f4f4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:52.688469 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7901d82e-b938-4ceb-9100-60a58367f4f4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:52.694604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7901d82e-b938-4ceb-9100-60a58367f4f4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:52.694604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7901d82e-b938-4ceb-9100-60a58367f4f4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:52.829746 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7901d82e-b938-4ceb-9100-60a58367f4f4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:52.838815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7901d82e-b938-4ceb-9100-60a58367f4f4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:52.840675 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7901d82e-b938-4ceb-9100-60a58367f4f4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:52.841782 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7901d82e-b938-4ceb-9100-60a58367f4f4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1407 microversion: 2.20 time: 0.166860 Jun 29 11:32:52.842536 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 395/799] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:52 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:32:53.859856 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-59351b46-caa9-4b5e-a05e-d1d5ff720cf2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:53.860501 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-59351b46-caa9-4b5e-a05e-d1d5ff720cf2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:53.866609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59351b46-caa9-4b5e-a05e-d1d5ff720cf2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:53.867053 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59351b46-caa9-4b5e-a05e-d1d5ff720cf2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:53.867800 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59351b46-caa9-4b5e-a05e-d1d5ff720cf2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:53.868252 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59351b46-caa9-4b5e-a05e-d1d5ff720cf2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:53.996906 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59351b46-caa9-4b5e-a05e-d1d5ff720cf2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:54.004736 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59351b46-caa9-4b5e-a05e-d1d5ff720cf2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:54.006224 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59351b46-caa9-4b5e-a05e-d1d5ff720cf2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:54.007317 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-59351b46-caa9-4b5e-a05e-d1d5ff720cf2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1407 microversion: 2.20 time: 0.151397 Jun 29 11:32:54.007885 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 405/800] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:53 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:54.261371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-9ba55e5d-2227-4a94-82f3-f40034750a01 req-38922c13-b6b3-49d7-bfe3-654635e1c362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d9da5-e4b3-407e-9b1d-4a33a8829015", "name": "network-vif-plugged", "status": "completed", "tag": "85554f15-efa6-4d62-91fa-d1490f006424"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:54.271149 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-9ba55e5d-2227-4a94-82f3-f40034750a01 req-38922c13-b6b3-49d7-bfe3-654635e1c362 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:54.271596 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-9ba55e5d-2227-4a94-82f3-f40034750a01 req-38922c13-b6b3-49d7-bfe3-654635e1c362 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:54.283594 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-9ba55e5d-2227-4a94-82f3-f40034750a01 req-38922c13-b6b3-49d7-bfe3-654635e1c362 service nova] Creating event network-vif-plugged:85554f15-efa6-4d62-91fa-d1490f006424 for instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 on hv-cinder-84733 Jun 29 11:32:54.288478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-9ba55e5d-2227-4a94-82f3-f40034750a01 req-38922c13-b6b3-49d7-bfe3-654635e1c362 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030994 Jun 29 11:32:54.289071 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 396/801] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:32:55.025267 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-de41c5fd-0761-416f-8bf7-0d7c10e84528 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:55.025818 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-de41c5fd-0761-416f-8bf7-0d7c10e84528 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:55.032822 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de41c5fd-0761-416f-8bf7-0d7c10e84528 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:55.033275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de41c5fd-0761-416f-8bf7-0d7c10e84528 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:55.034066 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de41c5fd-0761-416f-8bf7-0d7c10e84528 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:55.034505 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de41c5fd-0761-416f-8bf7-0d7c10e84528 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:55.165240 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-de41c5fd-0761-416f-8bf7-0d7c10e84528 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:55.173647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-de41c5fd-0761-416f-8bf7-0d7c10e84528 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:55.175159 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-de41c5fd-0761-416f-8bf7-0d7c10e84528 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:55.176294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-de41c5fd-0761-416f-8bf7-0d7c10e84528 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1407 microversion: 2.20 time: 0.155020 Jun 29 11:32:55.176853 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 406/802] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:55 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:56.195044 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-23f7cfc1-776e-4619-a80b-bc5c64ff1f8f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:56.195736 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-23f7cfc1-776e-4619-a80b-bc5c64ff1f8f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:56.197684 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:32:56.203169 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23f7cfc1-776e-4619-a80b-bc5c64ff1f8f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:56.208320 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23f7cfc1-776e-4619-a80b-bc5c64ff1f8f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:56.208320 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23f7cfc1-776e-4619-a80b-bc5c64ff1f8f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:56.208320 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23f7cfc1-776e-4619-a80b-bc5c64ff1f8f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:56.347684 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-23f7cfc1-776e-4619-a80b-bc5c64ff1f8f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:56.355794 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-23f7cfc1-776e-4619-a80b-bc5c64ff1f8f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:56.357323 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-23f7cfc1-776e-4619-a80b-bc5c64ff1f8f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:56.358406 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-23f7cfc1-776e-4619-a80b-bc5c64ff1f8f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1407 microversion: 2.20 time: 0.168128 Jun 29 11:32:56.358959 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 397/803] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:56 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:32:57.376443 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb2b264a-1977-41b0-a0ea-2689b987e7f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:57.377080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb2b264a-1977-41b0-a0ea-2689b987e7f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:57.383540 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb2b264a-1977-41b0-a0ea-2689b987e7f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:57.384029 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb2b264a-1977-41b0-a0ea-2689b987e7f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:57.384799 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb2b264a-1977-41b0-a0ea-2689b987e7f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:57.385235 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb2b264a-1977-41b0-a0ea-2689b987e7f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:57.513546 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb2b264a-1977-41b0-a0ea-2689b987e7f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:57.521427 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb2b264a-1977-41b0-a0ea-2689b987e7f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:57.522908 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb2b264a-1977-41b0-a0ea-2689b987e7f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:32:57.524078 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb2b264a-1977-41b0-a0ea-2689b987e7f3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1599 microversion: 2.20 time: 0.151595 Jun 29 11:32:57.524626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 407/804] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:32:57 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:32:57.541671 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4a2df004-a1fa-4448-a333-c2148a0b038a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:32:57.542160 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4a2df004-a1fa-4448-a333-c2148a0b038a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:32:57.549577 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4a2df004-a1fa-4448-a333-c2148a0b038a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:57.550014 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4a2df004-a1fa-4448-a333-c2148a0b038a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:57.550761 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4a2df004-a1fa-4448-a333-c2148a0b038a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:57.551189 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4a2df004-a1fa-4448-a333-c2148a0b038a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:57.629563 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4a2df004-a1fa-4448-a333-c2148a0b038a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091637 Jun 29 11:32:57.630463 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 398/805] 10.222.0.44 () {60 vars in 1315 bytes} [Wed Jun 29 11:32:57 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:32:58.803709 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-81e6567a-b19a-4c83-8176-3c419f29c1c3 req-324981ce-f95d-4fac-a59d-bc863b0be9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4d9da5-e4b3-407e-9b1d-4a33a8829015", "tag": "85554f15-efa6-4d62-91fa-d1490f006424"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:32:58.812681 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-81e6567a-b19a-4c83-8176-3c419f29c1c3 req-324981ce-f95d-4fac-a59d-bc863b0be9e1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:32:58.813125 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-81e6567a-b19a-4c83-8176-3c419f29c1c3 req-324981ce-f95d-4fac-a59d-bc863b0be9e1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:32:58.824297 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-81e6567a-b19a-4c83-8176-3c419f29c1c3 req-324981ce-f95d-4fac-a59d-bc863b0be9e1 service nova] Creating event network-changed:85554f15-efa6-4d62-91fa-d1490f006424 for instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 on hv-cinder-84733 Jun 29 11:32:58.830162 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-81e6567a-b19a-4c83-8176-3c419f29c1c3 req-324981ce-f95d-4fac-a59d-bc863b0be9e1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030088 Jun 29 11:32:58.830763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 408/806] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:03.112526 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:03.113282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=18 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:03.117528 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8e30e2ef-ed20-496b-9485-5caf846742b1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:03.117963 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8e30e2ef-ed20-496b-9485-5caf846742b1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:03.124072 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e30e2ef-ed20-496b-9485-5caf846742b1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:03.127017 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e30e2ef-ed20-496b-9485-5caf846742b1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:03.127017 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e30e2ef-ed20-496b-9485-5caf846742b1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:03.127017 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e30e2ef-ed20-496b-9485-5caf846742b1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:03.150941 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8e30e2ef-ed20-496b-9485-5caf846742b1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/ips" status: 200 len: 150 microversion: 2.1 time: 0.040463 Jun 29 11:34:03.155695 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 399/807] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jun 29 11:34:03 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:04.903975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:04.904772 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=56 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:04.910208 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e788e8d2-1d80-4bd4-856c-daa806130b5c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6e17a5e-9fc4-4162-81ba-ec3361fffb05"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:04.911347 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e788e8d2-1d80-4bd4-856c-daa806130b5c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:04.921724 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e788e8d2-1d80-4bd4-856c-daa806130b5c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:04.921724 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e788e8d2-1d80-4bd4-856c-daa806130b5c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:04.921724 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e788e8d2-1d80-4bd4-856c-daa806130b5c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:04.921724 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e788e8d2-1d80-4bd4-856c-daa806130b5c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:05.654079 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e788e8d2-1d80-4bd4-856c-daa806130b5c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752175 Jun 29 11:34:05.654705 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 409/808] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:34:04 2022] POST /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:14.182225 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b694e1f2-755e-43ea-ae58-d5278cecef90 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: .version_select at 0x7fd089553820>, body: {"keypair": {"name": "tempest-keypair-1184600714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1M7YumDZivDZv9GUMlLqc67FdufZ6Wug3zlW69kfW3aYmnkC9jEBT4obSgIVweoDZNIkzDzZusy1IyFUPulmIISohCxdtOxlyywU4edIgB+UX4GM6mjHPZnu3iaLBHTA=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:14.186850 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:14.197859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-b694e1f2-755e-43ea-ae58-d5278cecef90 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:34:14.201673 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-b694e1f2-755e-43ea-ae58-d5278cecef90 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for user cf7bc4681c954c158a7051046bd9aa47 and project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:34:14.306209 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b694e1f2-755e-43ea-ae58-d5278cecef90 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127823 Jun 29 11:34:14.306787 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 400/809] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jun 29 11:34:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:14.877129 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-59115645-8c64-4ddf-905a-a4bd052b0e78 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:14.877713 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-59115645-8c64-4ddf-905a-a4bd052b0e78 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:14.884988 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59115645-8c64-4ddf-905a-a4bd052b0e78 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:14.885424 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59115645-8c64-4ddf-905a-a4bd052b0e78 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:14.886178 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59115645-8c64-4ddf-905a-a4bd052b0e78 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:14.886606 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59115645-8c64-4ddf-905a-a4bd052b0e78 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:14.908946 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-59115645-8c64-4ddf-905a-a4bd052b0e78 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/ips" status: 200 len: 146 microversion: 2.1 time: 0.036720 Jun 29 11:34:14.917472 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 410/810] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jun 29 11:34:14 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:16.442932 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1212669319", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42f5ddc9-93c3-4cb7-9c4a-2481dc4d5579"}], "security_groups": [{"name": "tempest-securitygroup--231088218"}], "key_name": "tempest-keypair-1184600714", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:16.513387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-874373a4-ae90-47c6-8a0b-c4e79f24f730 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b047ddaa-a8f0-4abc-9316-6f614808c3d7"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:16.514518 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-874373a4-ae90-47c6-8a0b-c4e79f24f730 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:16.536157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-874373a4-ae90-47c6-8a0b-c4e79f24f730 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:16.536157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-874373a4-ae90-47c6-8a0b-c4e79f24f730 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:16.536157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-874373a4-ae90-47c6-8a0b-c4e79f24f730 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:16.536157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-874373a4-ae90-47c6-8a0b-c4e79f24f730 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:16.546563 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] validate_networks() for [('42f5ddc9-93c3-4cb7-9c4a-2481dc4d5579', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:34:16.920349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:34:16.925805 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:34:16.925805 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:34:16.925805 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:34:16.925805 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:34:16.930709 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:16.931148 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:16.931957 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:16.932418 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:16.948454 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:34:16.958896 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for user cf7bc4681c954c158a7051046bd9aa47 and project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:34:16.963454 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:34:16.965697 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:34:17.084335 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2f824840-9a02-4828-9ff9-da6fd70ea259 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.646705 Jun 29 11:34:17.084888 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 401/811] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:34:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:34:17.094544 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d2d6e092-087e-40eb-9422-76d8c54077a0 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:17.095184 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d2d6e092-087e-40eb-9422-76d8c54077a0 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:17.148703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d2d6e092-087e-40eb-9422-76d8c54077a0 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:17.156060 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d2d6e092-087e-40eb-9422-76d8c54077a0 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1242 microversion: 2.1 time: 0.065052 Jun 29 11:34:17.156747 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 402/812] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:17 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:34:17.282386 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-874373a4-ae90-47c6-8a0b-c4e79f24f730 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "POST /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.772727 Jun 29 11:34:17.282988 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 411/813] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:34:16 2022] POST /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments => generated 194 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:18.173114 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8eb7a005-85de-4aec-bdaf-46577b69294b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:18.173738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8eb7a005-85de-4aec-bdaf-46577b69294b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:18.180909 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8eb7a005-85de-4aec-bdaf-46577b69294b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:18.181347 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8eb7a005-85de-4aec-bdaf-46577b69294b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:18.182183 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8eb7a005-85de-4aec-bdaf-46577b69294b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:18.182526 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8eb7a005-85de-4aec-bdaf-46577b69294b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:18.248470 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8eb7a005-85de-4aec-bdaf-46577b69294b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:18.256027 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8eb7a005-85de-4aec-bdaf-46577b69294b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1238 microversion: 2.1 time: 0.086910 Jun 29 11:34:18.260698 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 403/814] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:18 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:19.275419 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e132aa2c-1dd7-44b0-b430-e10cfbfa917a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:19.276277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e132aa2c-1dd7-44b0-b430-e10cfbfa917a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:19.282305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e132aa2c-1dd7-44b0-b430-e10cfbfa917a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:19.282868 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e132aa2c-1dd7-44b0-b430-e10cfbfa917a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:19.283630 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e132aa2c-1dd7-44b0-b430-e10cfbfa917a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:19.284083 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e132aa2c-1dd7-44b0-b430-e10cfbfa917a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:19.348989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e132aa2c-1dd7-44b0-b430-e10cfbfa917a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:19.358863 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e132aa2c-1dd7-44b0-b430-e10cfbfa917a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1312 microversion: 2.1 time: 0.087601 Jun 29 11:34:19.358863 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 412/815] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:19 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1312 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:20.374832 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-52544515-3a16-4bac-bc87-df01a11b74cc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:20.375368 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-52544515-3a16-4bac-bc87-df01a11b74cc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:20.381992 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52544515-3a16-4bac-bc87-df01a11b74cc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:20.382513 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52544515-3a16-4bac-bc87-df01a11b74cc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:20.383344 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52544515-3a16-4bac-bc87-df01a11b74cc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:20.383867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52544515-3a16-4bac-bc87-df01a11b74cc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:20.583284 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-52544515-3a16-4bac-bc87-df01a11b74cc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:20.591252 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-52544515-3a16-4bac-bc87-df01a11b74cc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1367 microversion: 2.1 time: 0.220698 Jun 29 11:34:20.591818 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 404/816] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:20 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:21.012996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7e5298ce-ef3a-49c9-9bae-f93376e80a66 req-6f248c23-0852-474f-80fa-e7d558c9ace3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb83365-2340-4ffa-b755-a7cce647c923", "tag": "da6dd2cc-508f-4c22-b3e8-3f9e6701a87e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:21.022356 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7e5298ce-ef3a-49c9-9bae-f93376e80a66 req-6f248c23-0852-474f-80fa-e7d558c9ace3 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:21.024957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7e5298ce-ef3a-49c9-9bae-f93376e80a66 req-6f248c23-0852-474f-80fa-e7d558c9ace3 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:21.040178 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7e5298ce-ef3a-49c9-9bae-f93376e80a66 req-6f248c23-0852-474f-80fa-e7d558c9ace3 service nova] Creating event network-changed:da6dd2cc-508f-4c22-b3e8-3f9e6701a87e for instance 6bb83365-2340-4ffa-b755-a7cce647c923 on hv-cinder-84733 Jun 29 11:34:21.045047 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7e5298ce-ef3a-49c9-9bae-f93376e80a66 req-6f248c23-0852-474f-80fa-e7d558c9ace3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037893 Jun 29 11:34:21.045642 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 413/817] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:21.608847 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-16eafb6d-e742-4b27-b85a-6948c561be2b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:21.614694 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-16eafb6d-e742-4b27-b85a-6948c561be2b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:21.616046 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16eafb6d-e742-4b27-b85a-6948c561be2b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:21.616495 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16eafb6d-e742-4b27-b85a-6948c561be2b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:21.617267 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16eafb6d-e742-4b27-b85a-6948c561be2b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:21.617701 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16eafb6d-e742-4b27-b85a-6948c561be2b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:21.835458 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-16eafb6d-e742-4b27-b85a-6948c561be2b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:21.842857 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-16eafb6d-e742-4b27-b85a-6948c561be2b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1367 microversion: 2.1 time: 0.238354 Jun 29 11:34:21.843359 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 405/818] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:21 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:22.863175 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e708b1bb-23e8-422d-b980-f47ad4ea7727 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:22.863856 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e708b1bb-23e8-422d-b980-f47ad4ea7727 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:22.870238 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e708b1bb-23e8-422d-b980-f47ad4ea7727 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:22.870782 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e708b1bb-23e8-422d-b980-f47ad4ea7727 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:22.871653 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e708b1bb-23e8-422d-b980-f47ad4ea7727 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:22.872123 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e708b1bb-23e8-422d-b980-f47ad4ea7727 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:23.003131 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e708b1bb-23e8-422d-b980-f47ad4ea7727 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:23.010934 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e708b1bb-23e8-422d-b980-f47ad4ea7727 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1367 microversion: 2.1 time: 0.152572 Jun 29 11:34:23.011497 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 414/819] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:22 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:24.027482 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-be58ebf1-8509-499e-b82a-82165d74633a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:24.028103 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-be58ebf1-8509-499e-b82a-82165d74633a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:24.034488 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be58ebf1-8509-499e-b82a-82165d74633a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:24.034928 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be58ebf1-8509-499e-b82a-82165d74633a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:24.035676 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be58ebf1-8509-499e-b82a-82165d74633a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:24.036132 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be58ebf1-8509-499e-b82a-82165d74633a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:24.160546 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-be58ebf1-8509-499e-b82a-82165d74633a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:24.168284 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-be58ebf1-8509-499e-b82a-82165d74633a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1367 microversion: 2.1 time: 0.144624 Jun 29 11:34:24.168842 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 406/820] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:24 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:25.185079 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9af31ee0-33de-4ef0-b167-d45c826dccee tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:25.185714 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9af31ee0-33de-4ef0-b167-d45c826dccee tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:25.192127 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9af31ee0-33de-4ef0-b167-d45c826dccee tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:25.192612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9af31ee0-33de-4ef0-b167-d45c826dccee tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:25.194031 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9af31ee0-33de-4ef0-b167-d45c826dccee tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:25.194469 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9af31ee0-33de-4ef0-b167-d45c826dccee tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:25.324276 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9af31ee0-33de-4ef0-b167-d45c826dccee tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:25.331877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9af31ee0-33de-4ef0-b167-d45c826dccee tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1367 microversion: 2.1 time: 0.150710 Jun 29 11:34:25.332449 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 415/821] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:25 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:25.332596 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-42749429-ac07-4c84-b283-e80ad82f234c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:25.333020 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-42749429-ac07-4c84-b283-e80ad82f234c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:25.344762 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42749429-ac07-4c84-b283-e80ad82f234c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:25.345212 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42749429-ac07-4c84-b283-e80ad82f234c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:25.346443 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42749429-ac07-4c84-b283-e80ad82f234c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:25.347190 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42749429-ac07-4c84-b283-e80ad82f234c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:25.372773 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-42749429-ac07-4c84-b283-e80ad82f234c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/ips" status: 200 len: 152 microversion: 2.20 time: 0.044096 Jun 29 11:34:25.373348 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 407/822] 10.222.0.44 () {60 vars in 1288 bytes} [Wed Jun 29 11:34:25 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 11:34:25.838482 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4c486112-ee65-4a99-9868-d08892eceef5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:25.839454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4c486112-ee65-4a99-9868-d08892eceef5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:25.846372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c486112-ee65-4a99-9868-d08892eceef5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:25.846946 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c486112-ee65-4a99-9868-d08892eceef5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:25.847723 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c486112-ee65-4a99-9868-d08892eceef5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:25.848190 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c486112-ee65-4a99-9868-d08892eceef5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:25.881080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4c486112-ee65-4a99-9868-d08892eceef5 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047772 Jun 29 11:34:25.881649 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 416/823] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:34:25 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:25.891556 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b0f8d154-7406-4ac0-88c0-b37cb09b17e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:25.892081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b0f8d154-7406-4ac0-88c0-b37cb09b17e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:25.898832 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0f8d154-7406-4ac0-88c0-b37cb09b17e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:25.899451 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0f8d154-7406-4ac0-88c0-b37cb09b17e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:25.900406 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0f8d154-7406-4ac0-88c0-b37cb09b17e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:25.900845 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0f8d154-7406-4ac0-88c0-b37cb09b17e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:25.930734 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b0f8d154-7406-4ac0-88c0-b37cb09b17e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments/b047ddaa-a8f0-4abc-9316-6f614808c3d7" status: 200 len: 194 microversion: 2.1 time: 0.043025 Jun 29 11:34:25.931324 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 408/824] 10.222.0.44 () {58 vars in 1412 bytes} [Wed Jun 29 11:34:25 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments/b047ddaa-a8f0-4abc-9316-6f614808c3d7 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:26.348646 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-92a6669f-c380-4e89-94f5-d6aece90ae6c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:26.349409 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-92a6669f-c380-4e89-94f5-d6aece90ae6c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:26.357748 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92a6669f-c380-4e89-94f5-d6aece90ae6c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:26.358350 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92a6669f-c380-4e89-94f5-d6aece90ae6c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:26.359127 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92a6669f-c380-4e89-94f5-d6aece90ae6c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:26.359607 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92a6669f-c380-4e89-94f5-d6aece90ae6c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:26.515917 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-92a6669f-c380-4e89-94f5-d6aece90ae6c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:26.527434 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-92a6669f-c380-4e89-94f5-d6aece90ae6c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1367 microversion: 2.1 time: 0.179090 Jun 29 11:34:26.527434 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 417/825] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:26 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:27.540646 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-047c0069-9847-4053-89f8-e1700b594eaf tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:27.541237 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-047c0069-9847-4053-89f8-e1700b594eaf tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:27.543492 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:27.544187 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=12 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:27.549040 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-047c0069-9847-4053-89f8-e1700b594eaf tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:27.549484 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-047c0069-9847-4053-89f8-e1700b594eaf tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:27.550244 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-047c0069-9847-4053-89f8-e1700b594eaf tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:27.550674 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-047c0069-9847-4053-89f8-e1700b594eaf tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:27.689405 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-047c0069-9847-4053-89f8-e1700b594eaf tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:27.697068 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-047c0069-9847-4053-89f8-e1700b594eaf tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1367 microversion: 2.1 time: 0.160187 Jun 29 11:34:27.704118 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 409/826] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:27 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:28.500853 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f4a8c35-7b84-4e8f-ab12-74ada595dd80 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ba0dd3d-533b-406b-ab1a-c0e276f62046"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:28.501920 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6f4a8c35-7b84-4e8f-ab12-74ada595dd80 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:28.509013 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f4a8c35-7b84-4e8f-ab12-74ada595dd80 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:28.509490 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f4a8c35-7b84-4e8f-ab12-74ada595dd80 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:28.510252 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f4a8c35-7b84-4e8f-ab12-74ada595dd80 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:28.510687 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f4a8c35-7b84-4e8f-ab12-74ada595dd80 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:28.526443 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-52857b1a-e374-406e-93b0-b64596d4d08b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:28.526969 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-52857b1a-e374-406e-93b0-b64596d4d08b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:28.533015 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52857b1a-e374-406e-93b0-b64596d4d08b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:28.533456 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52857b1a-e374-406e-93b0-b64596d4d08b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:28.534203 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52857b1a-e374-406e-93b0-b64596d4d08b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:28.534629 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52857b1a-e374-406e-93b0-b64596d4d08b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:28.557603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-52857b1a-e374-406e-93b0-b64596d4d08b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lazy-loading 'flavor' on Instance uuid 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:34:29.093195 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-52857b1a-e374-406e-93b0-b64596d4d08b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "POST /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/action" status: 202 len: 0 microversion: 2.20 time: 0.570866 Jun 29 11:34:29.093812 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 410/827] 10.222.0.44 () {62 vars in 1318 bytes} [Wed Jun 29 11:34:28 2022] POST /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 29 11:34:29.098859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f5610982-140f-474f-b6ee-dad5695f9096 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:29.099540 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f5610982-140f-474f-b6ee-dad5695f9096 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:29.106898 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5610982-140f-474f-b6ee-dad5695f9096 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:29.107334 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5610982-140f-474f-b6ee-dad5695f9096 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:29.108106 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5610982-140f-474f-b6ee-dad5695f9096 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:29.108534 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5610982-140f-474f-b6ee-dad5695f9096 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:29.240202 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f5610982-140f-474f-b6ee-dad5695f9096 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:29.248188 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f5610982-140f-474f-b6ee-dad5695f9096 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1367 microversion: 2.1 time: 0.153147 Jun 29 11:34:29.248752 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 411/828] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:29 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:29.253221 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bd15581d-cc85-4cc2-aa05-f41e58799a9e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:29.253820 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bd15581d-cc85-4cc2-aa05-f41e58799a9e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:29.259599 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd15581d-cc85-4cc2-aa05-f41e58799a9e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:29.260150 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd15581d-cc85-4cc2-aa05-f41e58799a9e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:29.260907 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd15581d-cc85-4cc2-aa05-f41e58799a9e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:29.261344 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd15581d-cc85-4cc2-aa05-f41e58799a9e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:29.386031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bd15581d-cc85-4cc2-aa05-f41e58799a9e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:29.393832 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bd15581d-cc85-4cc2-aa05-f41e58799a9e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:29.395339 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bd15581d-cc85-4cc2-aa05-f41e58799a9e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:29.396510 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bd15581d-cc85-4cc2-aa05-f41e58799a9e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.146856 Jun 29 11:34:29.397586 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 412/829] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:29 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:30.264860 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-50f7d99b-bd58-47e2-b668-644e501e931a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:30.265511 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-50f7d99b-bd58-47e2-b668-644e501e931a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:30.272436 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50f7d99b-bd58-47e2-b668-644e501e931a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:30.272873 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50f7d99b-bd58-47e2-b668-644e501e931a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:30.273631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50f7d99b-bd58-47e2-b668-644e501e931a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:30.274064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50f7d99b-bd58-47e2-b668-644e501e931a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:30.406211 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-50f7d99b-bd58-47e2-b668-644e501e931a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:30.413926 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-50f7d99b-bd58-47e2-b668-644e501e931a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1367 microversion: 2.1 time: 0.152949 Jun 29 11:34:30.414509 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 413/830] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:30 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:34:30.418996 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-45e88195-8c48-470a-adca-a829b3bdb397 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:30.419591 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-45e88195-8c48-470a-adca-a829b3bdb397 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:30.425487 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45e88195-8c48-470a-adca-a829b3bdb397 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:30.425935 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45e88195-8c48-470a-adca-a829b3bdb397 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:30.426689 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45e88195-8c48-470a-adca-a829b3bdb397 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:30.427120 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45e88195-8c48-470a-adca-a829b3bdb397 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:30.554639 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-45e88195-8c48-470a-adca-a829b3bdb397 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:30.562388 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-45e88195-8c48-470a-adca-a829b3bdb397 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:30.563924 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-45e88195-8c48-470a-adca-a829b3bdb397 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:30.565066 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-45e88195-8c48-470a-adca-a829b3bdb397 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.149658 Jun 29 11:34:30.565613 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 414/831] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:30 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:31.430276 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-98650145-6ca8-44c8-80b7-7f7c25872529 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:31.430916 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-98650145-6ca8-44c8-80b7-7f7c25872529 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:31.437369 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98650145-6ca8-44c8-80b7-7f7c25872529 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:31.437809 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98650145-6ca8-44c8-80b7-7f7c25872529 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:31.438556 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98650145-6ca8-44c8-80b7-7f7c25872529 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:31.438982 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98650145-6ca8-44c8-80b7-7f7c25872529 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:31.568585 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-98650145-6ca8-44c8-80b7-7f7c25872529 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:31.575969 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-98650145-6ca8-44c8-80b7-7f7c25872529 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1367 microversion: 2.1 time: 0.150175 Jun 29 11:34:31.576528 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 415/832] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:31 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:34:31.581980 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3f668251-51c1-4a72-aad6-58dcb4fab5cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:31.582569 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3f668251-51c1-4a72-aad6-58dcb4fab5cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:31.589919 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f668251-51c1-4a72-aad6-58dcb4fab5cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:31.590359 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f668251-51c1-4a72-aad6-58dcb4fab5cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:31.591112 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f668251-51c1-4a72-aad6-58dcb4fab5cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:31.591538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f668251-51c1-4a72-aad6-58dcb4fab5cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:31.723009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3f668251-51c1-4a72-aad6-58dcb4fab5cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:31.726502 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:31.731668 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3f668251-51c1-4a72-aad6-58dcb4fab5cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:31.733299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3f668251-51c1-4a72-aad6-58dcb4fab5cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:31.734423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3f668251-51c1-4a72-aad6-58dcb4fab5cb tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.156066 Jun 29 11:34:31.734969 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 416/833] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:31 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:34:32.384120 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-7ae727c9-cdc7-44af-8f5f-662997a2ed28 req-b096096c-b19d-414b-8194-201a4bb6ce19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb83365-2340-4ffa-b755-a7cce647c923", "name": "network-vif-plugged", "status": "completed", "tag": "da6dd2cc-508f-4c22-b3e8-3f9e6701a87e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:32.393778 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7ae727c9-cdc7-44af-8f5f-662997a2ed28 req-b096096c-b19d-414b-8194-201a4bb6ce19 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:32.394223 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7ae727c9-cdc7-44af-8f5f-662997a2ed28 req-b096096c-b19d-414b-8194-201a4bb6ce19 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:32.407294 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-7ae727c9-cdc7-44af-8f5f-662997a2ed28 req-b096096c-b19d-414b-8194-201a4bb6ce19 service nova] Creating event network-vif-plugged:da6dd2cc-508f-4c22-b3e8-3f9e6701a87e for instance 6bb83365-2340-4ffa-b755-a7cce647c923 on hv-cinder-84733 Jun 29 11:34:32.412201 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-7ae727c9-cdc7-44af-8f5f-662997a2ed28 req-b096096c-b19d-414b-8194-201a4bb6ce19 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031807 Jun 29 11:34:32.413424 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 417/834] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:34:32.593311 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-edbfc62d-6452-4759-b062-669191a897f3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:32.593998 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-edbfc62d-6452-4759-b062-669191a897f3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:32.601665 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edbfc62d-6452-4759-b062-669191a897f3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:32.602065 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edbfc62d-6452-4759-b062-669191a897f3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:32.602823 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edbfc62d-6452-4759-b062-669191a897f3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:32.603248 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edbfc62d-6452-4759-b062-669191a897f3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:32.632176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6f4a8c35-7b84-4e8f-ab12-74ada595dd80 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "POST /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.134582 Jun 29 11:34:32.637449 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 418/835] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:34:28 2022] POST /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments => generated 194 bytes in 4137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:32.754908 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6a492687-c2e7-453b-b115-abde7b9433b4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:32.757985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6a492687-c2e7-453b-b115-abde7b9433b4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:32.760388 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-edbfc62d-6452-4759-b062-669191a897f3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:32.764825 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a492687-c2e7-453b-b115-abde7b9433b4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:32.765359 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a492687-c2e7-453b-b115-abde7b9433b4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:32.766133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a492687-c2e7-453b-b115-abde7b9433b4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:32.766574 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a492687-c2e7-453b-b115-abde7b9433b4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:32.770147 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-edbfc62d-6452-4759-b062-669191a897f3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1367 microversion: 2.1 time: 0.180044 Jun 29 11:34:32.770147 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 418/836] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:32 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:34:32.926596 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6a492687-c2e7-453b-b115-abde7b9433b4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:32.934656 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6a492687-c2e7-453b-b115-abde7b9433b4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:32.936182 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6a492687-c2e7-453b-b115-abde7b9433b4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:32.937335 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6a492687-c2e7-453b-b115-abde7b9433b4 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.187335 Jun 29 11:34:32.937890 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 419/837] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:32 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:34:33.790301 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f8f5a34f-00f9-482a-b4d3-cfc80a2423fa tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:33.791058 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f8f5a34f-00f9-482a-b4d3-cfc80a2423fa tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:33.797619 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f8f5a34f-00f9-482a-b4d3-cfc80a2423fa tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:33.798066 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f8f5a34f-00f9-482a-b4d3-cfc80a2423fa tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:33.798832 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f8f5a34f-00f9-482a-b4d3-cfc80a2423fa tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:33.799263 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f8f5a34f-00f9-482a-b4d3-cfc80a2423fa tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:33.935937 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f8f5a34f-00f9-482a-b4d3-cfc80a2423fa tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:33.943247 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f8f5a34f-00f9-482a-b4d3-cfc80a2423fa tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1367 microversion: 2.1 time: 0.157560 Jun 29 11:34:33.944115 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 419/838] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:33 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:33.955467 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d9d571d8-d5fa-4c15-89dc-b064df757a19 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:33.956107 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d9d571d8-d5fa-4c15-89dc-b064df757a19 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:33.962967 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9d571d8-d5fa-4c15-89dc-b064df757a19 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:33.963415 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9d571d8-d5fa-4c15-89dc-b064df757a19 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:33.964198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9d571d8-d5fa-4c15-89dc-b064df757a19 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:33.964636 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d9d571d8-d5fa-4c15-89dc-b064df757a19 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:34.092502 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d9d571d8-d5fa-4c15-89dc-b064df757a19 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:34.101109 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d9d571d8-d5fa-4c15-89dc-b064df757a19 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:34.102614 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d9d571d8-d5fa-4c15-89dc-b064df757a19 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:34.103783 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d9d571d8-d5fa-4c15-89dc-b064df757a19 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.152152 Jun 29 11:34:34.104359 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 420/839] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:33 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:34.960366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-27713dc3-1c6a-4470-bfa6-f3b48bf12420 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:34.960968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-27713dc3-1c6a-4470-bfa6-f3b48bf12420 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:34.967412 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27713dc3-1c6a-4470-bfa6-f3b48bf12420 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:34.967876 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27713dc3-1c6a-4470-bfa6-f3b48bf12420 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:34.968625 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27713dc3-1c6a-4470-bfa6-f3b48bf12420 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:34.969051 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27713dc3-1c6a-4470-bfa6-f3b48bf12420 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:35.100799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-27713dc3-1c6a-4470-bfa6-f3b48bf12420 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:35.108419 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-27713dc3-1c6a-4470-bfa6-f3b48bf12420 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1557 microversion: 2.1 time: 0.151885 Jun 29 11:34:35.108974 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 420/840] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:34 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:35.122822 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-00794bdc-fdbe-45f9-b780-7a94ab8aabbc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:35.123442 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00794bdc-fdbe-45f9-b780-7a94ab8aabbc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:35.124829 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-09c45db7-759b-4342-83d6-f27bed2323af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:35.125315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-09c45db7-759b-4342-83d6-f27bed2323af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:35.125871 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=25 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:35.130635 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00794bdc-fdbe-45f9-b780-7a94ab8aabbc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:35.131031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c45db7-759b-4342-83d6-f27bed2323af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:35.131166 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00794bdc-fdbe-45f9-b780-7a94ab8aabbc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:35.131508 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c45db7-759b-4342-83d6-f27bed2323af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:35.131855 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00794bdc-fdbe-45f9-b780-7a94ab8aabbc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:35.132303 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00794bdc-fdbe-45f9-b780-7a94ab8aabbc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:35.132477 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c45db7-759b-4342-83d6-f27bed2323af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:35.132826 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c45db7-759b-4342-83d6-f27bed2323af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:35.134894 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:35.236547 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-09c45db7-759b-4342-83d6-f27bed2323af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115407 Jun 29 11:34:35.237142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 421/841] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jun 29 11:34:35 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:34:35.386453 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00794bdc-fdbe-45f9-b780-7a94ab8aabbc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:35.394328 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00794bdc-fdbe-45f9-b780-7a94ab8aabbc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:35.395862 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00794bdc-fdbe-45f9-b780-7a94ab8aabbc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:35.397538 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-00794bdc-fdbe-45f9-b780-7a94ab8aabbc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.278440 Jun 29 11:34:35.398100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 421/842] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:35 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:36.416428 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-39d410b1-778e-42cc-8192-78c4dd0a5e4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:36.417055 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-39d410b1-778e-42cc-8192-78c4dd0a5e4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:36.423036 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-39d410b1-778e-42cc-8192-78c4dd0a5e4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:36.423479 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-39d410b1-778e-42cc-8192-78c4dd0a5e4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:36.424280 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-39d410b1-778e-42cc-8192-78c4dd0a5e4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:36.424727 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-39d410b1-778e-42cc-8192-78c4dd0a5e4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:36.468955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-930a5291-ab1a-413a-9cef-9d27af869f53 req-28f1991c-91fc-4bc3-b7de-7ea894347622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb83365-2340-4ffa-b755-a7cce647c923", "tag": "da6dd2cc-508f-4c22-b3e8-3f9e6701a87e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:36.481760 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-930a5291-ab1a-413a-9cef-9d27af869f53 req-28f1991c-91fc-4bc3-b7de-7ea894347622 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:36.482297 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-930a5291-ab1a-413a-9cef-9d27af869f53 req-28f1991c-91fc-4bc3-b7de-7ea894347622 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:36.494842 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-930a5291-ab1a-413a-9cef-9d27af869f53 req-28f1991c-91fc-4bc3-b7de-7ea894347622 service nova] Creating event network-changed:da6dd2cc-508f-4c22-b3e8-3f9e6701a87e for instance 6bb83365-2340-4ffa-b755-a7cce647c923 on hv-cinder-84733 Jun 29 11:34:36.501049 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-930a5291-ab1a-413a-9cef-9d27af869f53 req-28f1991c-91fc-4bc3-b7de-7ea894347622 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035874 Jun 29 11:34:36.501887 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 422/843] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:34:36.576732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-39d410b1-778e-42cc-8192-78c4dd0a5e4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:36.585363 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-39d410b1-778e-42cc-8192-78c4dd0a5e4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:36.587186 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-39d410b1-778e-42cc-8192-78c4dd0a5e4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:36.588585 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-39d410b1-778e-42cc-8192-78c4dd0a5e4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.177132 Jun 29 11:34:36.589257 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 422/844] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:36 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:37.607790 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3e5b1b16-7056-46e4-8e6d-765b6425aa39 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:37.608516 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3e5b1b16-7056-46e4-8e6d-765b6425aa39 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:37.614706 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e5b1b16-7056-46e4-8e6d-765b6425aa39 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:37.615157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e5b1b16-7056-46e4-8e6d-765b6425aa39 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:37.616558 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e5b1b16-7056-46e4-8e6d-765b6425aa39 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:37.617003 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e5b1b16-7056-46e4-8e6d-765b6425aa39 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:37.748871 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3e5b1b16-7056-46e4-8e6d-765b6425aa39 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:37.757329 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3e5b1b16-7056-46e4-8e6d-765b6425aa39 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:37.758871 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3e5b1b16-7056-46e4-8e6d-765b6425aa39 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:37.760068 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3e5b1b16-7056-46e4-8e6d-765b6425aa39 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.157260 Jun 29 11:34:37.760626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 423/845] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:37 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:38.785237 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f013107f-d67c-47ed-8cb7-f30831f14687 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:38.786376 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f013107f-d67c-47ed-8cb7-f30831f14687 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:38.792944 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f013107f-d67c-47ed-8cb7-f30831f14687 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:38.793414 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f013107f-d67c-47ed-8cb7-f30831f14687 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:38.794160 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f013107f-d67c-47ed-8cb7-f30831f14687 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:38.794586 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f013107f-d67c-47ed-8cb7-f30831f14687 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:38.921767 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f013107f-d67c-47ed-8cb7-f30831f14687 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:38.929695 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f013107f-d67c-47ed-8cb7-f30831f14687 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:38.931191 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f013107f-d67c-47ed-8cb7-f30831f14687 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:38.932404 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f013107f-d67c-47ed-8cb7-f30831f14687 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.151145 Jun 29 11:34:38.932958 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 423/846] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:38 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:34:39.950858 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ee8b8ac8-30a8-4796-ba90-456211cee54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:39.951465 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ee8b8ac8-30a8-4796-ba90-456211cee54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:39.957867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee8b8ac8-30a8-4796-ba90-456211cee54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:39.958307 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee8b8ac8-30a8-4796-ba90-456211cee54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:39.959056 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee8b8ac8-30a8-4796-ba90-456211cee54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:39.959543 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee8b8ac8-30a8-4796-ba90-456211cee54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:40.098170 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee8b8ac8-30a8-4796-ba90-456211cee54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:40.109512 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee8b8ac8-30a8-4796-ba90-456211cee54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:40.113616 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee8b8ac8-30a8-4796-ba90-456211cee54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:40.114862 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ee8b8ac8-30a8-4796-ba90-456211cee54e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.167822 Jun 29 11:34:40.115371 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 424/847] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:39 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:40.185073 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-667269698", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2084883613", "security_groups": [{"name": "tempest-secgroup-smoke-254433816"}], "block_device_mapping_v2": [{"uuid": "93c84534-fdb4-452d-941e-65cf336bb855", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "565f4274-f756-4c7f-9d43-992c92750ab4"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:40.293851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] validate_networks() for [('565f4274-f756-4c7f-9d43-992c92750ab4', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:34:40.666817 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:34:40.667239 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:34:40.667711 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:34:40.668143 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:34:40.668553 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:34:40.677382 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:40.677830 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:40.678628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:40.679065 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:40.695420 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Getting quotas for project cdc0456bfa5a4619a96b41d3437fd82c. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:34:40.699361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Getting quotas for user e91cc0b93f484f759233469ec5f37bb4 and project cdc0456bfa5a4619a96b41d3437fd82c. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:34:40.755253 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:34:40.757408 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93c84534-fdb4-452d-941e-65cf336bb855',volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:34:41.134978 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-93f26096-ae21-43ea-816b-e573e10e4723 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:41.135589 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-93f26096-ae21-43ea-816b-e573e10e4723 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:41.142015 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93f26096-ae21-43ea-816b-e573e10e4723 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:41.142923 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93f26096-ae21-43ea-816b-e573e10e4723 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:41.143197 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93f26096-ae21-43ea-816b-e573e10e4723 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:41.143629 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93f26096-ae21-43ea-816b-e573e10e4723 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:41.175009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5d93ed20-5f71-41d8-b55e-6a003289244b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.993542 Jun 29 11:34:41.175823 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 424/848] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:34:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:34:41.185764 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2418637b-f87e-4117-9dc1-0f6b62fcccbe tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:41.187067 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2418637b-f87e-4117-9dc1-0f6b62fcccbe tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:41.252243 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2418637b-f87e-4117-9dc1-0f6b62fcccbe tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:41.260351 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2418637b-f87e-4117-9dc1-0f6b62fcccbe tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1094 microversion: 2.1 time: 0.078565 Jun 29 11:34:41.261126 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 425/849] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:41 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:34:41.298715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-93f26096-ae21-43ea-816b-e573e10e4723 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:41.307563 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-93f26096-ae21-43ea-816b-e573e10e4723 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:41.309019 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-93f26096-ae21-43ea-816b-e573e10e4723 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:41.310169 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-93f26096-ae21-43ea-816b-e573e10e4723 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.179644 Jun 29 11:34:41.310717 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 425/850] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:41 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:34:42.234533 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-417bbc7f-8b20-4ca9-85df-80c9642113e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:42.235506 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-417bbc7f-8b20-4ca9-85df-80c9642113e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:42.239002 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:42.242524 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-417bbc7f-8b20-4ca9-85df-80c9642113e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:42.242970 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-417bbc7f-8b20-4ca9-85df-80c9642113e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:42.243721 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-417bbc7f-8b20-4ca9-85df-80c9642113e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:42.244183 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-417bbc7f-8b20-4ca9-85df-80c9642113e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:42.273617 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-417bbc7f-8b20-4ca9-85df-80c9642113e2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043329 Jun 29 11:34:42.278453 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 426/851] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:34:42 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:42.278609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4216b3fc-f25d-4293-91c8-1d4dea280676 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:42.278609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4216b3fc-f25d-4293-91c8-1d4dea280676 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:42.285134 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4216b3fc-f25d-4293-91c8-1d4dea280676 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:42.285581 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4216b3fc-f25d-4293-91c8-1d4dea280676 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:42.286343 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4216b3fc-f25d-4293-91c8-1d4dea280676 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:42.286981 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4216b3fc-f25d-4293-91c8-1d4dea280676 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:42.328465 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-41588c79-ed9d-46ee-aae3-1c835504bf64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:42.329075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-41588c79-ed9d-46ee-aae3-1c835504bf64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:42.335442 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-41588c79-ed9d-46ee-aae3-1c835504bf64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:42.335907 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-41588c79-ed9d-46ee-aae3-1c835504bf64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:42.336737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-41588c79-ed9d-46ee-aae3-1c835504bf64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:42.337133 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-41588c79-ed9d-46ee-aae3-1c835504bf64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:42.353361 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4216b3fc-f25d-4293-91c8-1d4dea280676 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:42.361397 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4216b3fc-f25d-4293-91c8-1d4dea280676 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1144 microversion: 2.1 time: 0.087204 Jun 29 11:34:42.362061 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 426/852] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:42 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:34:42.416839 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f696f34-ac26-4547-9cbc-f9459acfe071 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:42.417510 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8f696f34-ac26-4547-9cbc-f9459acfe071 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:42.423859 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f696f34-ac26-4547-9cbc-f9459acfe071 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:42.424334 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f696f34-ac26-4547-9cbc-f9459acfe071 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:42.425238 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f696f34-ac26-4547-9cbc-f9459acfe071 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:42.425613 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f696f34-ac26-4547-9cbc-f9459acfe071 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:42.456038 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8f696f34-ac26-4547-9cbc-f9459acfe071 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments/b047ddaa-a8f0-4abc-9316-6f614808c3d7" status: 200 len: 194 microversion: 2.1 time: 0.044025 Jun 29 11:34:42.460805 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 427/853] 10.222.0.44 () {58 vars in 1412 bytes} [Wed Jun 29 11:34:42 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments/b047ddaa-a8f0-4abc-9316-6f614808c3d7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:34:42.466734 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ed4f2960-281c-46cd-8b29-5d39a3ee8181 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:42.467240 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ed4f2960-281c-46cd-8b29-5d39a3ee8181 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:42.473588 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed4f2960-281c-46cd-8b29-5d39a3ee8181 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:42.474277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed4f2960-281c-46cd-8b29-5d39a3ee8181 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:42.475084 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed4f2960-281c-46cd-8b29-5d39a3ee8181 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:42.475521 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed4f2960-281c-46cd-8b29-5d39a3ee8181 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:42.481005 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-41588c79-ed9d-46ee-aae3-1c835504bf64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:42.490388 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-41588c79-ed9d-46ee-aae3-1c835504bf64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:42.492278 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-41588c79-ed9d-46ee-aae3-1c835504bf64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:42.493425 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-41588c79-ed9d-46ee-aae3-1c835504bf64 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.169157 Jun 29 11:34:42.494146 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 427/854] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:42 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:34:42.559052 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-ed4f2960-281c-46cd-8b29-5d39a3ee8181 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lazy-loading 'services' on Instance uuid fa0579c0-af58-4d2d-8083-2ef8eaad4f6e {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:34:42.825227 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ed4f2960-281c-46cd-8b29-5d39a3ee8181 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments/b047ddaa-a8f0-4abc-9316-6f614808c3d7" status: 202 len: 0 microversion: 2.1 time: 0.362176 Jun 29 11:34:42.825807 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 428/855] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jun 29 11:34:42 2022] DELETE /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments/b047ddaa-a8f0-4abc-9316-6f614808c3d7 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 11:34:43.378319 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1cef598e-4f86-489b-b275-cb5a0bf6501f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:43.379738 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1cef598e-4f86-489b-b275-cb5a0bf6501f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:43.388539 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1cef598e-4f86-489b-b275-cb5a0bf6501f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:43.390298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1cef598e-4f86-489b-b275-cb5a0bf6501f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:43.390298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1cef598e-4f86-489b-b275-cb5a0bf6501f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:43.390500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1cef598e-4f86-489b-b275-cb5a0bf6501f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:43.452274 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1cef598e-4f86-489b-b275-cb5a0bf6501f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:43.459690 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1cef598e-4f86-489b-b275-cb5a0bf6501f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1192 microversion: 2.1 time: 0.085372 Jun 29 11:34:43.460900 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 428/856] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:43 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:43.511963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3de14329-7ed8-4b13-98aa-07b1b2f6f7db tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:43.512663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3de14329-7ed8-4b13-98aa-07b1b2f6f7db tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:43.518918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3de14329-7ed8-4b13-98aa-07b1b2f6f7db tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:43.519372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3de14329-7ed8-4b13-98aa-07b1b2f6f7db tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:43.520483 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3de14329-7ed8-4b13-98aa-07b1b2f6f7db tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:43.520588 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3de14329-7ed8-4b13-98aa-07b1b2f6f7db tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:43.651038 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3de14329-7ed8-4b13-98aa-07b1b2f6f7db tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:43.658835 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3de14329-7ed8-4b13-98aa-07b1b2f6f7db tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:43.660386 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3de14329-7ed8-4b13-98aa-07b1b2f6f7db tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:43.661534 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3de14329-7ed8-4b13-98aa-07b1b2f6f7db tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1745 microversion: 2.20 time: 0.154378 Jun 29 11:34:43.662088 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 429/857] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:43 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:44.476780 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-645a49fc-9970-48c3-9e56-6351f658fbb8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:44.478066 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-645a49fc-9970-48c3-9e56-6351f658fbb8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:44.486856 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-645a49fc-9970-48c3-9e56-6351f658fbb8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:44.487398 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-645a49fc-9970-48c3-9e56-6351f658fbb8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:44.488264 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-645a49fc-9970-48c3-9e56-6351f658fbb8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:44.488794 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-645a49fc-9970-48c3-9e56-6351f658fbb8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:44.586123 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-645a49fc-9970-48c3-9e56-6351f658fbb8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:44.594395 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-645a49fc-9970-48c3-9e56-6351f658fbb8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1210 microversion: 2.1 time: 0.121384 Jun 29 11:34:44.598292 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 429/858] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:44 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1210 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:44.680844 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4f742ab5-73eb-4855-8ce4-0dc961ae4b68 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:44.684422 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4f742ab5-73eb-4855-8ce4-0dc961ae4b68 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:44.688070 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f742ab5-73eb-4855-8ce4-0dc961ae4b68 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:44.688514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f742ab5-73eb-4855-8ce4-0dc961ae4b68 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:44.689277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f742ab5-73eb-4855-8ce4-0dc961ae4b68 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:44.689710 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f742ab5-73eb-4855-8ce4-0dc961ae4b68 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:44.912767 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4f742ab5-73eb-4855-8ce4-0dc961ae4b68 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:44.922448 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4f742ab5-73eb-4855-8ce4-0dc961ae4b68 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:44.924049 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4f742ab5-73eb-4855-8ce4-0dc961ae4b68 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:44.925859 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4f742ab5-73eb-4855-8ce4-0dc961ae4b68 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1745 microversion: 2.20 time: 0.248293 Jun 29 11:34:44.926436 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 430/859] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:44 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1745 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:45.007677 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ddc911ce-29e7-4750-b768-8391fa99fa17 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:45.008206 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ddc911ce-29e7-4750-b768-8391fa99fa17 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:45.014962 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ddc911ce-29e7-4750-b768-8391fa99fa17 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:45.015408 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ddc911ce-29e7-4750-b768-8391fa99fa17 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:45.016195 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ddc911ce-29e7-4750-b768-8391fa99fa17 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:45.016628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ddc911ce-29e7-4750-b768-8391fa99fa17 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:45.047571 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ddc911ce-29e7-4750-b768-8391fa99fa17 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments/3ba0dd3d-533b-406b-ab1a-c0e276f62046" status: 200 len: 194 microversion: 2.1 time: 0.044090 Jun 29 11:34:45.048126 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 430/860] 10.222.0.44 () {58 vars in 1412 bytes} [Wed Jun 29 11:34:45 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments/3ba0dd3d-533b-406b-ab1a-c0e276f62046 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:45.058513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2d60280-240d-47f7-8b9c-a7361ede61b9 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:45.059153 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e2d60280-240d-47f7-8b9c-a7361ede61b9 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:45.065104 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2d60280-240d-47f7-8b9c-a7361ede61b9 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:45.065738 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2d60280-240d-47f7-8b9c-a7361ede61b9 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:45.066691 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2d60280-240d-47f7-8b9c-a7361ede61b9 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:45.067135 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2d60280-240d-47f7-8b9c-a7361ede61b9 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:45.152212 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-e2d60280-240d-47f7-8b9c-a7361ede61b9 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lazy-loading 'services' on Instance uuid fa0579c0-af58-4d2d-8083-2ef8eaad4f6e {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:34:45.408392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2d60280-240d-47f7-8b9c-a7361ede61b9 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments/3ba0dd3d-533b-406b-ab1a-c0e276f62046" status: 202 len: 0 microversion: 2.1 time: 0.354168 Jun 29 11:34:45.409081 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 431/861] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jun 29 11:34:45 2022] DELETE /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments/3ba0dd3d-533b-406b-ab1a-c0e276f62046 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:34:45.611371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-27228f7e-2f48-4879-a429-17d5272977fb tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:45.611925 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-27228f7e-2f48-4879-a429-17d5272977fb tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:45.618317 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27228f7e-2f48-4879-a429-17d5272977fb tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:45.618768 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27228f7e-2f48-4879-a429-17d5272977fb tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:45.620138 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27228f7e-2f48-4879-a429-17d5272977fb tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:45.620569 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27228f7e-2f48-4879-a429-17d5272977fb tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:45.786277 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-27228f7e-2f48-4879-a429-17d5272977fb tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:45.796207 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-27228f7e-2f48-4879-a429-17d5272977fb tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1277 microversion: 2.1 time: 0.188318 Jun 29 11:34:45.797241 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 431/862] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:45 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:45.944592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-89b454e3-2f37-437e-8fff-f5997841170c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:45.945301 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-89b454e3-2f37-437e-8fff-f5997841170c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:45.952793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89b454e3-2f37-437e-8fff-f5997841170c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:45.953248 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89b454e3-2f37-437e-8fff-f5997841170c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:45.954179 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89b454e3-2f37-437e-8fff-f5997841170c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:45.954614 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89b454e3-2f37-437e-8fff-f5997841170c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:46.164939 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-89b454e3-2f37-437e-8fff-f5997841170c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:46.174570 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-89b454e3-2f37-437e-8fff-f5997841170c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:46.176166 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-89b454e3-2f37-437e-8fff-f5997841170c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:46.177348 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-89b454e3-2f37-437e-8fff-f5997841170c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1745 microversion: 2.20 time: 0.237150 Jun 29 11:34:46.177904 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 432/863] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:45 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1745 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:46.404708 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-92c3d56f-32f1-4343-89c4-37e842e174c0 req-027b266f-5814-4ef3-892c-98cfa9dbc1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d9da5-e4b3-407e-9b1d-4a33a8829015", "name": "network-vif-plugged", "status": "completed", "tag": "85554f15-efa6-4d62-91fa-d1490f006424"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:46.415034 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-92c3d56f-32f1-4343-89c4-37e842e174c0 req-027b266f-5814-4ef3-892c-98cfa9dbc1b4 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:46.415721 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-92c3d56f-32f1-4343-89c4-37e842e174c0 req-027b266f-5814-4ef3-892c-98cfa9dbc1b4 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:46.428737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-92c3d56f-32f1-4343-89c4-37e842e174c0 req-027b266f-5814-4ef3-892c-98cfa9dbc1b4 service nova] Creating event network-vif-plugged:85554f15-efa6-4d62-91fa-d1490f006424 for instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 on hv-cinder-84733 Jun 29 11:34:46.436085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-92c3d56f-32f1-4343-89c4-37e842e174c0 req-027b266f-5814-4ef3-892c-98cfa9dbc1b4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036358 Jun 29 11:34:46.444500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 432/864] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:34:46.636662 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c7c85432-828e-4897-a874-cc1e7b0c4a43 req-f24702ba-28af-4927-b6aa-0c82d9de209c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a258c3-e36f-4542-bef5-586c66bb0e15", "tag": "880f98df-d8a5-4578-a7a6-a37e254c889d"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:46.647416 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c7c85432-828e-4897-a874-cc1e7b0c4a43 req-f24702ba-28af-4927-b6aa-0c82d9de209c service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:46.647636 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c7c85432-828e-4897-a874-cc1e7b0c4a43 req-f24702ba-28af-4927-b6aa-0c82d9de209c service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:46.667573 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c7c85432-828e-4897-a874-cc1e7b0c4a43 req-f24702ba-28af-4927-b6aa-0c82d9de209c service nova] Creating event network-changed:880f98df-d8a5-4578-a7a6-a37e254c889d for instance 98a258c3-e36f-4542-bef5-586c66bb0e15 on hv-cinder-84733 Jun 29 11:34:46.672575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c7c85432-828e-4897-a874-cc1e7b0c4a43 req-f24702ba-28af-4927-b6aa-0c82d9de209c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041279 Jun 29 11:34:46.673189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 433/865] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:34:46.818978 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-24579042-9f23-48ef-8666-fb4a4ef710d0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:46.819674 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-24579042-9f23-48ef-8666-fb4a4ef710d0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:46.826540 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24579042-9f23-48ef-8666-fb4a4ef710d0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:46.826980 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24579042-9f23-48ef-8666-fb4a4ef710d0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:46.827727 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24579042-9f23-48ef-8666-fb4a4ef710d0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:46.828186 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24579042-9f23-48ef-8666-fb4a4ef710d0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:46.967252 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-24579042-9f23-48ef-8666-fb4a4ef710d0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:46.974709 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-24579042-9f23-48ef-8666-fb4a4ef710d0 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1277 microversion: 2.1 time: 0.160350 Jun 29 11:34:46.975266 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 433/866] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:46 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:34:47.196591 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0f7800ff-2e34-49e5-981d-073cb6e0ff8e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:47.197354 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0f7800ff-2e34-49e5-981d-073cb6e0ff8e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:47.204237 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f7800ff-2e34-49e5-981d-073cb6e0ff8e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:47.204687 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f7800ff-2e34-49e5-981d-073cb6e0ff8e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:47.205452 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f7800ff-2e34-49e5-981d-073cb6e0ff8e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:47.205891 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f7800ff-2e34-49e5-981d-073cb6e0ff8e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:47.393850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0f7800ff-2e34-49e5-981d-073cb6e0ff8e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:47.402255 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0f7800ff-2e34-49e5-981d-073cb6e0ff8e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:47.403740 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0f7800ff-2e34-49e5-981d-073cb6e0ff8e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:47.404919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0f7800ff-2e34-49e5-981d-073cb6e0ff8e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1745 microversion: 2.20 time: 0.212886 Jun 29 11:34:47.405538 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 434/867] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:47 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1745 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:47.992316 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c8b35732-5d53-4b5b-ae68-aca42cdc3baf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:47.993553 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c8b35732-5d53-4b5b-ae68-aca42cdc3baf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:48.000959 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c8b35732-5d53-4b5b-ae68-aca42cdc3baf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:48.001754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c8b35732-5d53-4b5b-ae68-aca42cdc3baf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:48.002727 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c8b35732-5d53-4b5b-ae68-aca42cdc3baf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:48.003361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c8b35732-5d53-4b5b-ae68-aca42cdc3baf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:48.139293 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c8b35732-5d53-4b5b-ae68-aca42cdc3baf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:48.146580 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c8b35732-5d53-4b5b-ae68-aca42cdc3baf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1265 microversion: 2.1 time: 0.158136 Jun 29 11:34:48.147137 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 434/868] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:47 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:48.423443 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5b8bd7ec-2d3f-4881-9851-4a2990aee3cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:48.424043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5b8bd7ec-2d3f-4881-9851-4a2990aee3cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:48.430347 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b8bd7ec-2d3f-4881-9851-4a2990aee3cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:48.430791 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b8bd7ec-2d3f-4881-9851-4a2990aee3cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:48.431539 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b8bd7ec-2d3f-4881-9851-4a2990aee3cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:48.432605 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b8bd7ec-2d3f-4881-9851-4a2990aee3cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:48.570911 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5b8bd7ec-2d3f-4881-9851-4a2990aee3cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:48.578894 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5b8bd7ec-2d3f-4881-9851-4a2990aee3cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:48.580460 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5b8bd7ec-2d3f-4881-9851-4a2990aee3cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:48.581631 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5b8bd7ec-2d3f-4881-9851-4a2990aee3cc tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1745 microversion: 2.20 time: 0.162214 Jun 29 11:34:48.582178 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 435/869] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:48 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:48.675185 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8dffea57-70bc-41c7-8cc4-c62ad421e271 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:48.676070 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8dffea57-70bc-41c7-8cc4-c62ad421e271 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:48.682423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8dffea57-70bc-41c7-8cc4-c62ad421e271 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:48.682864 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8dffea57-70bc-41c7-8cc4-c62ad421e271 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:48.683603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8dffea57-70bc-41c7-8cc4-c62ad421e271 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:48.684062 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8dffea57-70bc-41c7-8cc4-c62ad421e271 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:48.711512 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8dffea57-70bc-41c7-8cc4-c62ad421e271 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040260 Jun 29 11:34:48.712071 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 435/870] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:34:48 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 11:34:48.813001 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5283db9f-03c9-4e6a-844f-3c7e3f3df6aa tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:48.813952 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5283db9f-03c9-4e6a-844f-3c7e3f3df6aa tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:48.819845 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5283db9f-03c9-4e6a-844f-3c7e3f3df6aa tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:48.820306 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5283db9f-03c9-4e6a-844f-3c7e3f3df6aa tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:48.821073 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5283db9f-03c9-4e6a-844f-3c7e3f3df6aa tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:48.821510 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5283db9f-03c9-4e6a-844f-3c7e3f3df6aa tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:48.859426 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5283db9f-03c9-4e6a-844f-3c7e3f3df6aa tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050277 Jun 29 11:34:48.859997 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 436/871] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:34:48 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 11:34:48.917912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-43215ccb-104a-4858-9622-f215df51fbdc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:48.918400 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-43215ccb-104a-4858-9622-f215df51fbdc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:48.924371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-43215ccb-104a-4858-9622-f215df51fbdc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:48.924815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-43215ccb-104a-4858-9622-f215df51fbdc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:48.925619 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-43215ccb-104a-4858-9622-f215df51fbdc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:48.926030 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-43215ccb-104a-4858-9622-f215df51fbdc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:48.950922 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-43215ccb-104a-4858-9622-f215df51fbdc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:34:48.953625 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:49.163255 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e03da8be-e1dd-45af-92a9-0091fa332cd5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:49.163889 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e03da8be-e1dd-45af-92a9-0091fa332cd5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:49.170373 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e03da8be-e1dd-45af-92a9-0091fa332cd5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:49.170821 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e03da8be-e1dd-45af-92a9-0091fa332cd5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:49.171590 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e03da8be-e1dd-45af-92a9-0091fa332cd5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:49.172061 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e03da8be-e1dd-45af-92a9-0091fa332cd5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:49.227392 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-43215ccb-104a-4858-9622-f215df51fbdc tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 204 len: 0 microversion: 2.1 time: 0.313011 Jun 29 11:34:49.228354 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 436/872] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:34:48 2022] DELETE /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:34:49.238366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e7696491-b885-4f54-b8a9-761f8ba412c3 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:49.239120 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e7696491-b885-4f54-b8a9-761f8ba412c3 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:49.246156 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7696491-b885-4f54-b8a9-761f8ba412c3 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:49.246694 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7696491-b885-4f54-b8a9-761f8ba412c3 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:49.247526 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7696491-b885-4f54-b8a9-761f8ba412c3 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:49.248067 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7696491-b885-4f54-b8a9-761f8ba412c3 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:49.332461 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e03da8be-e1dd-45af-92a9-0091fa332cd5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:49.334728 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:49.340895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e03da8be-e1dd-45af-92a9-0091fa332cd5 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1265 microversion: 2.1 time: 0.181454 Jun 29 11:34:49.341558 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 437/873] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:49 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:34:49.399695 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e7696491-b885-4f54-b8a9-761f8ba412c3 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:49.407595 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e7696491-b885-4f54-b8a9-761f8ba412c3 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1674 microversion: 2.1 time: 0.174092 Jun 29 11:34:49.408180 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 437/874] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:49 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:34:49.599623 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a28822d1-ec3e-41bf-be81-a32eb65f333c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:49.600277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a28822d1-ec3e-41bf-be81-a32eb65f333c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:49.607997 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a28822d1-ec3e-41bf-be81-a32eb65f333c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:49.608440 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a28822d1-ec3e-41bf-be81-a32eb65f333c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:49.609187 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a28822d1-ec3e-41bf-be81-a32eb65f333c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:49.609618 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a28822d1-ec3e-41bf-be81-a32eb65f333c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:49.735510 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a28822d1-ec3e-41bf-be81-a32eb65f333c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:49.743403 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a28822d1-ec3e-41bf-be81-a32eb65f333c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:49.744938 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a28822d1-ec3e-41bf-be81-a32eb65f333c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:49.746086 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a28822d1-ec3e-41bf-be81-a32eb65f333c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1745 microversion: 2.20 time: 0.150700 Jun 29 11:34:49.746640 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 438/875] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:49 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:50.358519 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0b44dfa3-535a-4f6a-9788-92dcc8068ae1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:50.359124 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0b44dfa3-535a-4f6a-9788-92dcc8068ae1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:50.365668 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b44dfa3-535a-4f6a-9788-92dcc8068ae1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:50.366109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b44dfa3-535a-4f6a-9788-92dcc8068ae1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:50.366854 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b44dfa3-535a-4f6a-9788-92dcc8068ae1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:50.367282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b44dfa3-535a-4f6a-9788-92dcc8068ae1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:50.425518 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-896bb977-b0ba-44e7-8745-943149ad3703 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:50.426050 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-896bb977-b0ba-44e7-8745-943149ad3703 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:50.432260 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896bb977-b0ba-44e7-8745-943149ad3703 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:50.432921 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896bb977-b0ba-44e7-8745-943149ad3703 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:50.433686 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896bb977-b0ba-44e7-8745-943149ad3703 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:50.434126 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896bb977-b0ba-44e7-8745-943149ad3703 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:50.542152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0b44dfa3-535a-4f6a-9788-92dcc8068ae1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:50.549559 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0b44dfa3-535a-4f6a-9788-92dcc8068ae1 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1265 microversion: 2.1 time: 0.195689 Jun 29 11:34:50.550116 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 438/876] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:50 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:50.585809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-896bb977-b0ba-44e7-8745-943149ad3703 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:50.593902 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-896bb977-b0ba-44e7-8745-943149ad3703 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1674 microversion: 2.1 time: 0.172437 Jun 29 11:34:50.594476 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 439/877] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:50 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:34:50.764836 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-37ca77d6-5aab-4b60-b005-9696b4dba37b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:50.765463 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-37ca77d6-5aab-4b60-b005-9696b4dba37b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:50.767354 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:50.772171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37ca77d6-5aab-4b60-b005-9696b4dba37b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:50.772618 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37ca77d6-5aab-4b60-b005-9696b4dba37b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:50.773403 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37ca77d6-5aab-4b60-b005-9696b4dba37b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:50.773842 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37ca77d6-5aab-4b60-b005-9696b4dba37b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:50.913507 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-37ca77d6-5aab-4b60-b005-9696b4dba37b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:50.921898 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-37ca77d6-5aab-4b60-b005-9696b4dba37b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:50.923416 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-37ca77d6-5aab-4b60-b005-9696b4dba37b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:50.924638 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-37ca77d6-5aab-4b60-b005-9696b4dba37b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1745 microversion: 2.20 time: 0.164451 Jun 29 11:34:50.925204 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 439/878] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:50 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:51.566402 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4e2302a-469c-4cd1-a76a-996d3c1ed03d tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:51.567017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d4e2302a-469c-4cd1-a76a-996d3c1ed03d tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:51.573394 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4e2302a-469c-4cd1-a76a-996d3c1ed03d tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:51.573865 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4e2302a-469c-4cd1-a76a-996d3c1ed03d tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:51.574608 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4e2302a-469c-4cd1-a76a-996d3c1ed03d tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:51.575044 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4e2302a-469c-4cd1-a76a-996d3c1ed03d tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:51.611202 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c358b8fc-dc87-4283-865b-f12050987278 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:51.611800 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c358b8fc-dc87-4283-865b-f12050987278 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:51.622981 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=8 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:34:51.622981 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c358b8fc-dc87-4283-865b-f12050987278 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:51.622981 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c358b8fc-dc87-4283-865b-f12050987278 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:51.622981 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c358b8fc-dc87-4283-865b-f12050987278 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:51.623391 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c358b8fc-dc87-4283-865b-f12050987278 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:51.770583 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d4e2302a-469c-4cd1-a76a-996d3c1ed03d tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:51.779593 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d4e2302a-469c-4cd1-a76a-996d3c1ed03d tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1265 microversion: 2.1 time: 0.216991 Jun 29 11:34:51.780603 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 440/879] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:51 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:51.807386 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c358b8fc-dc87-4283-865b-f12050987278 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:51.814894 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c358b8fc-dc87-4283-865b-f12050987278 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1674 microversion: 2.1 time: 0.207474 Jun 29 11:34:51.815457 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 440/880] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:51 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1674 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:34:51.942657 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bf499fa4-d15c-4b39-b524-59fbc6498407 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:51.943272 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bf499fa4-d15c-4b39-b524-59fbc6498407 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:51.949549 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf499fa4-d15c-4b39-b524-59fbc6498407 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:51.950015 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf499fa4-d15c-4b39-b524-59fbc6498407 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:51.950772 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf499fa4-d15c-4b39-b524-59fbc6498407 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:51.951211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf499fa4-d15c-4b39-b524-59fbc6498407 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:52.086316 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bf499fa4-d15c-4b39-b524-59fbc6498407 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:52.095249 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bf499fa4-d15c-4b39-b524-59fbc6498407 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:52.096778 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bf499fa4-d15c-4b39-b524-59fbc6498407 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:52.097940 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bf499fa4-d15c-4b39-b524-59fbc6498407 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1740 microversion: 2.20 time: 0.159317 Jun 29 11:34:52.098500 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 441/881] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:51 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:52.683633 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-63620cc2-bad7-4ce0-a6da-13218cd72463 req-f9411890-0608-45d3-a795-27e1e6bf14da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0579c0-af58-4d2d-8083-2ef8eaad4f6e", "name": "network-vif-deleted", "tag": "3c962a59-c58e-4bdb-8951-1fd2bc37814e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:52.699455 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-63620cc2-bad7-4ce0-a6da-13218cd72463 req-f9411890-0608-45d3-a795-27e1e6bf14da service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:52.699931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-63620cc2-bad7-4ce0-a6da-13218cd72463 req-f9411890-0608-45d3-a795-27e1e6bf14da service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:52.715927 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-63620cc2-bad7-4ce0-a6da-13218cd72463 req-f9411890-0608-45d3-a795-27e1e6bf14da service nova] Creating event network-vif-deleted:3c962a59-c58e-4bdb-8951-1fd2bc37814e for instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e on hv-cinder-84733 Jun 29 11:34:52.721475 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-63620cc2-bad7-4ce0-a6da-13218cd72463 req-f9411890-0608-45d3-a795-27e1e6bf14da service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042050 Jun 29 11:34:52.722265 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 441/882] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:34:52.798127 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c82277c1-5351-4ac1-9419-4b21f72abb94 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:52.816688 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c82277c1-5351-4ac1-9419-4b21f72abb94 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:52.826160 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c82277c1-5351-4ac1-9419-4b21f72abb94 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:52.826859 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c82277c1-5351-4ac1-9419-4b21f72abb94 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:52.827860 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c82277c1-5351-4ac1-9419-4b21f72abb94 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:52.828455 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c82277c1-5351-4ac1-9419-4b21f72abb94 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:52.833053 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dac8b55c-a4b5-4a4e-aa7d-6ab21af56885 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:52.838462 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dac8b55c-a4b5-4a4e-aa7d-6ab21af56885 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:52.856208 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dac8b55c-a4b5-4a4e-aa7d-6ab21af56885 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:52.861771 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dac8b55c-a4b5-4a4e-aa7d-6ab21af56885 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:52.863384 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dac8b55c-a4b5-4a4e-aa7d-6ab21af56885 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:52.864163 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dac8b55c-a4b5-4a4e-aa7d-6ab21af56885 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:53.050211 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dac8b55c-a4b5-4a4e-aa7d-6ab21af56885 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e0b3528b14856b73dc441c52d1d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c08a3d7e74f45999d1ba0ab11781458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:53.061962 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dac8b55c-a4b5-4a4e-aa7d-6ab21af56885 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 200 len: 1322 microversion: 2.1 time: 0.232868 Jun 29 11:34:53.062956 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 442/883] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:52 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:53.091982 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c82277c1-5351-4ac1-9419-4b21f72abb94 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:53.099875 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c82277c1-5351-4ac1-9419-4b21f72abb94 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1265 microversion: 2.1 time: 0.307666 Jun 29 11:34:53.100454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 442/884] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:52 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:53.117082 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6275ee5d-27c9-494e-a431-f9db7dff974b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:53.117946 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6275ee5d-27c9-494e-a431-f9db7dff974b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:53.126782 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6275ee5d-27c9-494e-a431-f9db7dff974b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:53.127230 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6275ee5d-27c9-494e-a431-f9db7dff974b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:53.128252 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6275ee5d-27c9-494e-a431-f9db7dff974b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:53.128697 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6275ee5d-27c9-494e-a431-f9db7dff974b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:53.288285 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6275ee5d-27c9-494e-a431-f9db7dff974b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:53.301859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6275ee5d-27c9-494e-a431-f9db7dff974b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:53.304062 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6275ee5d-27c9-494e-a431-f9db7dff974b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:53.306198 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6275ee5d-27c9-494e-a431-f9db7dff974b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1740 microversion: 2.20 time: 0.192572 Jun 29 11:34:53.318767 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 443/885] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:53 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:54.085528 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-41caa707-5a72-4f82-b7a4-7f8b417efa9c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:54.086980 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-41caa707-5a72-4f82-b7a4-7f8b417efa9c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:54.095516 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41caa707-5a72-4f82-b7a4-7f8b417efa9c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:54.096397 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41caa707-5a72-4f82-b7a4-7f8b417efa9c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:54.103122 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41caa707-5a72-4f82-b7a4-7f8b417efa9c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:54.103122 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41caa707-5a72-4f82-b7a4-7f8b417efa9c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:54.117307 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-35e440f3-157d-4ba3-8dc2-731bca6e312e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:54.118593 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-35e440f3-157d-4ba3-8dc2-731bca6e312e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:54.119395 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-41caa707-5a72-4f82-b7a4-7f8b417efa9c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] HTTP exception thrown: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-41caa707-5a72-4f82-b7a4-7f8b417efa9c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Request method failure captured: Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e HTTP/1.1 Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZ-8incjbxmujlKuz3CJQOJVBav3TyJX0tubvWNLqyuwRTccMSn2gin46DfsQlkeN5Y83bNa_FLdcRdpaaK-PKnVX3BsbA4w-G6gDdr1-F4mZVddanDg40Wvy10jB_zatiuJWwnnpS_u2j-nmz-Gk2xRA9e8J2fkCRDFiMFCniKkOk Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 2c08a3d7e74f45999d1ba0ab11781458 Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:34:54.121793 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:34:54.124043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2c08a3d7e74f45999d1ba0ab11781458"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2c08a3d7e74f45999d1ba0ab11781458", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c08a3d7e74f45999d1ba0ab11781458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c08a3d7e74f45999d1ba0ab11781458"}]}] Jun 29 11:34:54.124043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:54.124043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 2c08a3d7e74f45999d1ba0ab11781458 Jun 29 11:34:54.124043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:54.124043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-1285507198-project Jun 29 11:34:54.124043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:34:54.124043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:34:54.124043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: f75e0b3528b14856b73dc441c52d1d73 Jun 29 11:34:54.124043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-1285507198-project Jun 29 11:34:54.124043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:34:54.124043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:54.124043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': 'fa0579c0-af58-4d2d-8083-2ef8eaad4f6e'} Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:34:54.124975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:54.126785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:54.128298 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-41caa707-5a72-4f82-b7a4-7f8b417efa9c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Returning 404 to user: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:34:54.128400 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35e440f3-157d-4ba3-8dc2-731bca6e312e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:54.128400 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35e440f3-157d-4ba3-8dc2-731bca6e312e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:54.128799 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-41caa707-5a72-4f82-b7a4-7f8b417efa9c tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 404 len: 111 microversion: 2.1 time: 0.048734 Jun 29 11:34:54.129443 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 443/886] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:54 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:34:54.129640 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35e440f3-157d-4ba3-8dc2-731bca6e312e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:54.130082 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35e440f3-157d-4ba3-8dc2-731bca6e312e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:54.139095 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ee6a9b9b-1a75-4367-b62d-1b4f7e05d6b6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '.version_select at 0x7fd0895b33a0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:54.229492 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ee6a9b9b-1a75-4367-b62d-1b4f7e05d6b6 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-945297564" status: 202 len: 0 microversion: 2.1 time: 0.094748 Jun 29 11:34:54.243223 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 444/887] 10.222.0.44 () {58 vars in 1217 bytes} [Wed Jun 29 11:34:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-945297564 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:34:54.312946 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-35e440f3-157d-4ba3-8dc2-731bca6e312e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:54.322935 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-35e440f3-157d-4ba3-8dc2-731bca6e312e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1265 microversion: 2.1 time: 0.209685 Jun 29 11:34:54.326599 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a7bc7fb4-a1dd-4233-9176-1016c3d3074d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:54.327415 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a7bc7fb4-a1dd-4233-9176-1016c3d3074d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:54.328065 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 444/888] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:54 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:54.335743 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7bc7fb4-a1dd-4233-9176-1016c3d3074d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:54.336318 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7bc7fb4-a1dd-4233-9176-1016c3d3074d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:54.338368 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7bc7fb4-a1dd-4233-9176-1016c3d3074d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:54.339304 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7bc7fb4-a1dd-4233-9176-1016c3d3074d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:54.495104 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a7bc7fb4-a1dd-4233-9176-1016c3d3074d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:54.503711 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a7bc7fb4-a1dd-4233-9176-1016c3d3074d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:54.505158 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a7bc7fb4-a1dd-4233-9176-1016c3d3074d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:54.506329 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a7bc7fb4-a1dd-4233-9176-1016c3d3074d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1740 microversion: 2.20 time: 0.185815 Jun 29 11:34:54.518698 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 445/889] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:54 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:34:55.351226 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b449fe95-b7d6-48a9-b8e8-a97dcd4f8d5e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:55.351880 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b449fe95-b7d6-48a9-b8e8-a97dcd4f8d5e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:55.360889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b449fe95-b7d6-48a9-b8e8-a97dcd4f8d5e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:55.361643 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b449fe95-b7d6-48a9-b8e8-a97dcd4f8d5e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:55.362428 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b449fe95-b7d6-48a9-b8e8-a97dcd4f8d5e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:55.362867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b449fe95-b7d6-48a9-b8e8-a97dcd4f8d5e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:55.506859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b449fe95-b7d6-48a9-b8e8-a97dcd4f8d5e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:55.515095 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b449fe95-b7d6-48a9-b8e8-a97dcd4f8d5e tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1265 microversion: 2.1 time: 0.174355 Jun 29 11:34:55.515665 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 445/890] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:55 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:55.525230 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5e40416c-8bfa-42c0-ae8f-f98f62be3cec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:55.525856 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5e40416c-8bfa-42c0-ae8f-f98f62be3cec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:55.532799 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e40416c-8bfa-42c0-ae8f-f98f62be3cec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:55.533244 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e40416c-8bfa-42c0-ae8f-f98f62be3cec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:55.533999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e40416c-8bfa-42c0-ae8f-f98f62be3cec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:55.535224 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e40416c-8bfa-42c0-ae8f-f98f62be3cec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:55.832666 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e40416c-8bfa-42c0-ae8f-f98f62be3cec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:55.840486 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e40416c-8bfa-42c0-ae8f-f98f62be3cec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:55.841992 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e40416c-8bfa-42c0-ae8f-f98f62be3cec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:55.843148 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5e40416c-8bfa-42c0-ae8f-f98f62be3cec tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1740 microversion: 2.20 time: 0.321787 Jun 29 11:34:55.843706 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 446/891] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:55 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:56.533062 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-be965047-ccdd-48ae-b563-9c97efebcf3b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:56.533959 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-be965047-ccdd-48ae-b563-9c97efebcf3b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:56.540418 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be965047-ccdd-48ae-b563-9c97efebcf3b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:56.541373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be965047-ccdd-48ae-b563-9c97efebcf3b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:56.542435 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be965047-ccdd-48ae-b563-9c97efebcf3b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:56.542978 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be965047-ccdd-48ae-b563-9c97efebcf3b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:56.728136 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-be965047-ccdd-48ae-b563-9c97efebcf3b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:56.740177 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-be965047-ccdd-48ae-b563-9c97efebcf3b tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1265 microversion: 2.1 time: 0.211019 Jun 29 11:34:56.740696 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 446/892] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:56 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:34:56.862188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-18305bce-a5b1-4e49-a05c-2c2034230372 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:56.862830 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-18305bce-a5b1-4e49-a05c-2c2034230372 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:56.869988 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18305bce-a5b1-4e49-a05c-2c2034230372 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:56.870540 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18305bce-a5b1-4e49-a05c-2c2034230372 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:56.871582 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18305bce-a5b1-4e49-a05c-2c2034230372 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:56.872064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18305bce-a5b1-4e49-a05c-2c2034230372 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:57.031700 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-18305bce-a5b1-4e49-a05c-2c2034230372 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:57.040196 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-18305bce-a5b1-4e49-a05c-2c2034230372 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:57.041694 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-18305bce-a5b1-4e49-a05c-2c2034230372 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:57.043458 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-18305bce-a5b1-4e49-a05c-2c2034230372 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1740 microversion: 2.20 time: 0.185331 Jun 29 11:34:57.044056 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 447/893] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:56 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:57.757977 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f44822af-8426-420e-9a4f-74a8c3a6a762 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:57.759421 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f44822af-8426-420e-9a4f-74a8c3a6a762 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:57.767922 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f44822af-8426-420e-9a4f-74a8c3a6a762 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:57.768714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f44822af-8426-420e-9a4f-74a8c3a6a762 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:57.769883 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f44822af-8426-420e-9a4f-74a8c3a6a762 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:57.770414 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f44822af-8426-420e-9a4f-74a8c3a6a762 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:57.923190 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f44822af-8426-420e-9a4f-74a8c3a6a762 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:57.931055 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f44822af-8426-420e-9a4f-74a8c3a6a762 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1265 microversion: 2.1 time: 0.177040 Jun 29 11:34:57.931638 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 447/894] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:57 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:58.062308 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2fe1faab-fa36-49cd-b9c9-8e2c3c194857 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:58.063129 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2fe1faab-fa36-49cd-b9c9-8e2c3c194857 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:58.069653 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fe1faab-fa36-49cd-b9c9-8e2c3c194857 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:58.070071 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fe1faab-fa36-49cd-b9c9-8e2c3c194857 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:58.070912 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fe1faab-fa36-49cd-b9c9-8e2c3c194857 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:58.071528 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fe1faab-fa36-49cd-b9c9-8e2c3c194857 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:58.212971 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2fe1faab-fa36-49cd-b9c9-8e2c3c194857 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:58.227396 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2fe1faab-fa36-49cd-b9c9-8e2c3c194857 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:58.229217 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2fe1faab-fa36-49cd-b9c9-8e2c3c194857 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:58.232590 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2fe1faab-fa36-49cd-b9c9-8e2c3c194857 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1740 microversion: 2.20 time: 0.174450 Jun 29 11:34:58.234180 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 448/895] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:58 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:58.271269 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ac6b0dce-e90b-4133-9b15-ef5cf7b60a8f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:58.272096 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ac6b0dce-e90b-4133-9b15-ef5cf7b60a8f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:58.278869 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ac6b0dce-e90b-4133-9b15-ef5cf7b60a8f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:58.279628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ac6b0dce-e90b-4133-9b15-ef5cf7b60a8f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:58.280574 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ac6b0dce-e90b-4133-9b15-ef5cf7b60a8f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:58.281084 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ac6b0dce-e90b-4133-9b15-ef5cf7b60a8f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:58.296882 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-ac6b0dce-e90b-4133-9b15-ef5cf7b60a8f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] HTTP exception thrown: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ac6b0dce-e90b-4133-9b15-ef5cf7b60a8f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Request method failure captured: Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e HTTP/1.1 Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDZ-8incjbxmujlKuz3CJQOJVBav3TyJX0tubvWNLqyuwRTccMSn2gin46DfsQlkeN5Y83bNa_FLdcRdpaaK-PKnVX3BsbA4w-G6gDdr1-F4mZVddanDg40Wvy10jB_zatiuJWwnnpS_u2j-nmz-Gk2xRA9e8J2fkCRDFiMFCniKkOk Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 2c08a3d7e74f45999d1ba0ab11781458 Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:34:58.298631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:34:58.300193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2c08a3d7e74f45999d1ba0ab11781458"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2c08a3d7e74f45999d1ba0ab11781458", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c08a3d7e74f45999d1ba0ab11781458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c08a3d7e74f45999d1ba0ab11781458"}]}] Jun 29 11:34:58.300193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:58.300193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 2c08a3d7e74f45999d1ba0ab11781458 Jun 29 11:34:58.300193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:58.300193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeTestJSON-1285507198-project Jun 29 11:34:58.300193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:34:58.300193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:34:58.300193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: f75e0b3528b14856b73dc441c52d1d73 Jun 29 11:34:58.300193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeTestJSON-1285507198-project Jun 29 11:34:58.300193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:34:58.300193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:58.300193 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': 'fa0579c0-af58-4d2d-8083-2ef8eaad4f6e'} Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:34:58.301076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:58.302745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:34:58.305177 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ac6b0dce-e90b-4133-9b15-ef5cf7b60a8f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Returning 404 to user: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:34:58.305177 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ac6b0dce-e90b-4133-9b15-ef5cf7b60a8f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 404 len: 111 microversion: 2.1 time: 0.032981 Jun 29 11:34:58.309663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-adaab4a1-8145-41d5-bda9-a14774652c2f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:58.310288 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-adaab4a1-8145-41d5-bda9-a14774652c2f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: fa0579c0-af58-4d2d-8083-2ef8eaad4f6e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:58.315650 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 448/896] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:34:58 2022] DELETE /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:34:58.316850 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adaab4a1-8145-41d5-bda9-a14774652c2f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:58.317508 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adaab4a1-8145-41d5-bda9-a14774652c2f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:58.318463 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adaab4a1-8145-41d5-bda9-a14774652c2f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:58.319063 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adaab4a1-8145-41d5-bda9-a14774652c2f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:58.333863 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-adaab4a1-8145-41d5-bda9-a14774652c2f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] HTTP exception thrown: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-adaab4a1-8145-41d5-bda9-a14774652c2f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Request method failure captured: Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e HTTP/1.1 Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZ-8incjbxmujlKuz3CJQOJVBav3TyJX0tubvWNLqyuwRTccMSn2gin46DfsQlkeN5Y83bNa_FLdcRdpaaK-PKnVX3BsbA4w-G6gDdr1-F4mZVddanDg40Wvy10jB_zatiuJWwnnpS_u2j-nmz-Gk2xRA9e8J2fkCRDFiMFCniKkOk Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 2c08a3d7e74f45999d1ba0ab11781458 Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:34:58.336080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:34:58.337478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2c08a3d7e74f45999d1ba0ab11781458"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2c08a3d7e74f45999d1ba0ab11781458", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c08a3d7e74f45999d1ba0ab11781458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c08a3d7e74f45999d1ba0ab11781458"}]}] Jun 29 11:34:58.337478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:58.337478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 2c08a3d7e74f45999d1ba0ab11781458 Jun 29 11:34:58.337478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:58.337478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-1285507198-project Jun 29 11:34:58.337478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:34:58.337478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:34:58.337478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: f75e0b3528b14856b73dc441c52d1d73 Jun 29 11:34:58.337478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-1285507198-project Jun 29 11:34:58.337478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:34:58.337478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:58.337478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': 'fa0579c0-af58-4d2d-8083-2ef8eaad4f6e'} Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:34:58.338198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. Jun 29 11:34:58.339435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:58.340917 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-adaab4a1-8145-41d5-bda9-a14774652c2f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Returning 404 to user: Instance fa0579c0-af58-4d2d-8083-2ef8eaad4f6e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:34:58.341781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-adaab4a1-8145-41d5-bda9-a14774652c2f tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e" status: 404 len: 111 microversion: 2.1 time: 0.036723 Jun 29 11:34:58.345818 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 449/897] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:58 2022] GET /compute/v2.1/servers/fa0579c0-af58-4d2d-8083-2ef8eaad4f6e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 11:34:58.575918 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-37aa8f20-0865-4148-827e-8563e858738d req-c981eeca-0538-46a8-8501-cf2314042533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a258c3-e36f-4542-bef5-586c66bb0e15", "name": "network-vif-plugged", "status": "completed", "tag": "880f98df-d8a5-4578-a7a6-a37e254c889d"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:34:58.592257 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-37aa8f20-0865-4148-827e-8563e858738d req-c981eeca-0538-46a8-8501-cf2314042533 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:58.592792 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-37aa8f20-0865-4148-827e-8563e858738d req-c981eeca-0538-46a8-8501-cf2314042533 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:58.607948 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-37aa8f20-0865-4148-827e-8563e858738d req-c981eeca-0538-46a8-8501-cf2314042533 service nova] Creating event network-vif-plugged:880f98df-d8a5-4578-a7a6-a37e254c889d for instance 98a258c3-e36f-4542-bef5-586c66bb0e15 on hv-cinder-84733 Jun 29 11:34:58.613279 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-37aa8f20-0865-4148-827e-8563e858738d req-c981eeca-0538-46a8-8501-cf2314042533 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044451 Jun 29 11:34:58.614016 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 449/898] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:34:58.948310 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-718ae0db-2819-4130-952a-acbc20235a5f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:58.948965 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-718ae0db-2819-4130-952a-acbc20235a5f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:58.964082 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-718ae0db-2819-4130-952a-acbc20235a5f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:58.964708 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-718ae0db-2819-4130-952a-acbc20235a5f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:58.966578 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-718ae0db-2819-4130-952a-acbc20235a5f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:58.966578 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-718ae0db-2819-4130-952a-acbc20235a5f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:59.150916 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-718ae0db-2819-4130-952a-acbc20235a5f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:59.159754 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-718ae0db-2819-4130-952a-acbc20235a5f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1265 microversion: 2.1 time: 0.215650 Jun 29 11:34:59.161429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 450/899] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:58 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:34:59.254092 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b1209549-f384-4293-9bea-c075d2c2d071 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:59.254825 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b1209549-f384-4293-9bea-c075d2c2d071 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:59.262965 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1209549-f384-4293-9bea-c075d2c2d071 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:59.263647 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1209549-f384-4293-9bea-c075d2c2d071 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:59.270087 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1209549-f384-4293-9bea-c075d2c2d071 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:59.270087 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1209549-f384-4293-9bea-c075d2c2d071 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:59.408566 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b1209549-f384-4293-9bea-c075d2c2d071 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:59.417395 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b1209549-f384-4293-9bea-c075d2c2d071 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:59.419033 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b1209549-f384-4293-9bea-c075d2c2d071 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:34:59.420216 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b1209549-f384-4293-9bea-c075d2c2d071 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1740 microversion: 2.20 time: 0.171115 Jun 29 11:34:59.420772 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 450/900] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:34:59 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:34:59.668984 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d53ff39-2949-4614-a48a-b04c07aa6e2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:59.669533 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0d53ff39-2949-4614-a48a-b04c07aa6e2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:59.675824 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d53ff39-2949-4614-a48a-b04c07aa6e2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:59.676306 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d53ff39-2949-4614-a48a-b04c07aa6e2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:59.677062 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d53ff39-2949-4614-a48a-b04c07aa6e2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:59.677493 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d53ff39-2949-4614-a48a-b04c07aa6e2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:59.693758 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-0d53ff39-2949-4614-a48a-b04c07aa6e2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] HTTP exception thrown: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d53ff39-2949-4614-a48a-b04c07aa6e2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Request method failure captured: Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e HTTP/1.1 Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDZ-8incjbxmujlKuz3CJQOJVBav3TyJX0tubvWNLqyuwRTccMSn2gin46DfsQlkeN5Y83bNa_FLdcRdpaaK-PKnVX3BsbA4w-G6gDdr1-F4mZVddanDg40Wvy10jB_zatiuJWwnnpS_u2j-nmz-Gk2xRA9e8J2fkCRDFiMFCniKkOk Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 2c08a3d7e74f45999d1ba0ab11781458 Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:34:59.695367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:34:59.697034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2c08a3d7e74f45999d1ba0ab11781458"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2c08a3d7e74f45999d1ba0ab11781458", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c08a3d7e74f45999d1ba0ab11781458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c08a3d7e74f45999d1ba0ab11781458"}]}] Jun 29 11:34:59.697034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:59.697034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 2c08a3d7e74f45999d1ba0ab11781458 Jun 29 11:34:59.697034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:59.697034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-1285507198-project Jun 29 11:34:59.697034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:34:59.697034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:34:59.697034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: f75e0b3528b14856b73dc441c52d1d73 Jun 29 11:34:59.697034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-1285507198-project Jun 29 11:34:59.697034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:34:59.697034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:34:59.697034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e'} Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:34:59.697943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:34:59.699431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:34:59.701755 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d53ff39-2949-4614-a48a-b04c07aa6e2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Returning 404 to user: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:34:59.701755 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0d53ff39-2949-4614-a48a-b04c07aa6e2a tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "DELETE /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 404 len: 111 microversion: 2.1 time: 0.032402 Jun 29 11:34:59.701755 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 451/901] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:34:59 2022] DELETE /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 11:34:59.705941 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fdb455a2-b7b1-4699-9ab3-7bd5878ab3a2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:34:59.710347 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fdb455a2-b7b1-4699-9ab3-7bd5878ab3a2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] [instance: 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:34:59.712723 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fdb455a2-b7b1-4699-9ab3-7bd5878ab3a2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:59.713207 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fdb455a2-b7b1-4699-9ab3-7bd5878ab3a2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:59.714013 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fdb455a2-b7b1-4699-9ab3-7bd5878ab3a2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:34:59.714484 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fdb455a2-b7b1-4699-9ab3-7bd5878ab3a2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:34:59.728491 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-fdb455a2-b7b1-4699-9ab3-7bd5878ab3a2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] HTTP exception thrown: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fdb455a2-b7b1-4699-9ab3-7bd5878ab3a2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Request method failure captured: Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e HTTP/1.1 Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDZ-8incjbxmujlKuz3CJQOJVBav3TyJX0tubvWNLqyuwRTccMSn2gin46DfsQlkeN5Y83bNa_FLdcRdpaaK-PKnVX3BsbA4w-G6gDdr1-F4mZVddanDg40Wvy10jB_zatiuJWwnnpS_u2j-nmz-Gk2xRA9e8J2fkCRDFiMFCniKkOk Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 2c08a3d7e74f45999d1ba0ab11781458 Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:34:59.730102 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:34:59.732063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2c08a3d7e74f45999d1ba0ab11781458"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2c08a3d7e74f45999d1ba0ab11781458", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c08a3d7e74f45999d1ba0ab11781458"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c08a3d7e74f45999d1ba0ab11781458"}]}] Jun 29 11:34:59.732063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:59.732063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 2c08a3d7e74f45999d1ba0ab11781458 Jun 29 11:34:59.732063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1285507198 Jun 29 11:34:59.732063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeTestJSON-1285507198-project Jun 29 11:34:59.732063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:34:59.732063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:34:59.732063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: f75e0b3528b14856b73dc441c52d1d73 Jun 29 11:34:59.732063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeTestJSON-1285507198-project Jun 29 11:34:59.732063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:34:59.732063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:34:59.732063 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': '00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e'} Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:34:59.733153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. Jun 29 11:34:59.734612 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:34:59.736073 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fdb455a2-b7b1-4699-9ab3-7bd5878ab3a2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] Returning 404 to user: Instance 00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:34:59.736073 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fdb455a2-b7b1-4699-9ab3-7bd5878ab3a2 tempest-AttachVolumeTestJSON-1285507198 tempest-AttachVolumeTestJSON-1285507198-project] 10.222.0.44 "GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e" status: 404 len: 111 microversion: 2.1 time: 0.029778 Jun 29 11:34:59.736073 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 451/902] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:34:59 2022] GET /compute/v2.1/servers/00fbe5c6-b79c-4c32-9c9c-6c23bae13b0e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:35:00.177059 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e78e90ec-6fa3-4840-81c7-82311d989df8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:00.177614 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e78e90ec-6fa3-4840-81c7-82311d989df8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:00.186390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e78e90ec-6fa3-4840-81c7-82311d989df8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:00.187173 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e78e90ec-6fa3-4840-81c7-82311d989df8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:00.188018 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e78e90ec-6fa3-4840-81c7-82311d989df8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:00.188686 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e78e90ec-6fa3-4840-81c7-82311d989df8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:00.348944 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e78e90ec-6fa3-4840-81c7-82311d989df8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:00.358315 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e78e90ec-6fa3-4840-81c7-82311d989df8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1265 microversion: 2.1 time: 0.185185 Jun 29 11:35:00.358894 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 452/903] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:35:00 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:35:00.441183 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-05ca4884-1b81-41bd-9eb4-576fb0c4ee54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:00.442624 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-05ca4884-1b81-41bd-9eb4-576fb0c4ee54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:00.451183 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-05ca4884-1b81-41bd-9eb4-576fb0c4ee54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:00.452277 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-05ca4884-1b81-41bd-9eb4-576fb0c4ee54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:00.453244 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-05ca4884-1b81-41bd-9eb4-576fb0c4ee54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:00.454132 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-05ca4884-1b81-41bd-9eb4-576fb0c4ee54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:00.638649 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-05ca4884-1b81-41bd-9eb4-576fb0c4ee54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:00.647700 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-05ca4884-1b81-41bd-9eb4-576fb0c4ee54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:00.650988 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-05ca4884-1b81-41bd-9eb4-576fb0c4ee54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:00.653104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-05ca4884-1b81-41bd-9eb4-576fb0c4ee54 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1740 microversion: 2.20 time: 0.216492 Jun 29 11:35:00.653820 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 452/904] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:00 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:01.376750 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c6573fc5-b39d-4577-9414-980c177596c4 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:01.377162 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c6573fc5-b39d-4577-9414-980c177596c4 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:01.392122 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6573fc5-b39d-4577-9414-980c177596c4 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:01.392834 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6573fc5-b39d-4577-9414-980c177596c4 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:01.393818 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6573fc5-b39d-4577-9414-980c177596c4 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:01.394256 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6573fc5-b39d-4577-9414-980c177596c4 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:01.552408 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c6573fc5-b39d-4577-9414-980c177596c4 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:01.562070 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c6573fc5-b39d-4577-9414-980c177596c4 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1451 microversion: 2.1 time: 0.190495 Jun 29 11:35:01.562641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 453/905] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:35:01 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1451 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:35:01.580395 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-600fd8f2-9725-448f-b19c-97a07a1442bf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:01.581632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-600fd8f2-9725-448f-b19c-97a07a1442bf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:01.589648 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-600fd8f2-9725-448f-b19c-97a07a1442bf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:01.590437 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-600fd8f2-9725-448f-b19c-97a07a1442bf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:01.591465 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-600fd8f2-9725-448f-b19c-97a07a1442bf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:01.592151 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-600fd8f2-9725-448f-b19c-97a07a1442bf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:01.673518 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d62d0013-9197-44bb-aba3-f626cdae5ce2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:01.674505 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d62d0013-9197-44bb-aba3-f626cdae5ce2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:01.694492 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d62d0013-9197-44bb-aba3-f626cdae5ce2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:01.694950 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d62d0013-9197-44bb-aba3-f626cdae5ce2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:01.695911 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d62d0013-9197-44bb-aba3-f626cdae5ce2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:01.696351 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d62d0013-9197-44bb-aba3-f626cdae5ce2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:01.773702 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-600fd8f2-9725-448f-b19c-97a07a1442bf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:01.784807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-600fd8f2-9725-448f-b19c-97a07a1442bf tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1451 microversion: 2.1 time: 0.207449 Jun 29 11:35:01.785991 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 453/906] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:35:01 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1451 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:35:01.949288 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d62d0013-9197-44bb-aba3-f626cdae5ce2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:01.963406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d62d0013-9197-44bb-aba3-f626cdae5ce2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:01.966140 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d62d0013-9197-44bb-aba3-f626cdae5ce2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:01.967672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d62d0013-9197-44bb-aba3-f626cdae5ce2 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1740 microversion: 2.20 time: 0.299983 Jun 29 11:35:01.968982 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 454/907] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:01 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:02.990420 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-63e64e85-2af0-4f76-97c6-a26bedaf9088 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:02.991659 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-63e64e85-2af0-4f76-97c6-a26bedaf9088 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:03.007334 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63e64e85-2af0-4f76-97c6-a26bedaf9088 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:03.011069 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63e64e85-2af0-4f76-97c6-a26bedaf9088 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:03.012763 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63e64e85-2af0-4f76-97c6-a26bedaf9088 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:03.013660 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63e64e85-2af0-4f76-97c6-a26bedaf9088 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:03.063965 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:35:03.681986 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-63e64e85-2af0-4f76-97c6-a26bedaf9088 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:03.697037 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-63e64e85-2af0-4f76-97c6-a26bedaf9088 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:03.698970 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-63e64e85-2af0-4f76-97c6-a26bedaf9088 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:03.700918 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-63e64e85-2af0-4f76-97c6-a26bedaf9088 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1740 microversion: 2.20 time: 0.715857 Jun 29 11:35:03.701456 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 454/908] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:02 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1740 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:04.725545 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9eca5c57-e4ef-48ab-b27a-d4289e7439fd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:04.726848 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9eca5c57-e4ef-48ab-b27a-d4289e7439fd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:04.743146 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9eca5c57-e4ef-48ab-b27a-d4289e7439fd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:04.744016 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9eca5c57-e4ef-48ab-b27a-d4289e7439fd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:04.744975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9eca5c57-e4ef-48ab-b27a-d4289e7439fd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:04.745609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9eca5c57-e4ef-48ab-b27a-d4289e7439fd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:04.960692 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9eca5c57-e4ef-48ab-b27a-d4289e7439fd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:04.968999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9eca5c57-e4ef-48ab-b27a-d4289e7439fd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:04.970524 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9eca5c57-e4ef-48ab-b27a-d4289e7439fd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:04.971721 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9eca5c57-e4ef-48ab-b27a-d4289e7439fd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1740 microversion: 2.20 time: 0.254834 Jun 29 11:35:04.972327 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 455/909] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:04 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:05.320874 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-673bbeb7-6fa3-4cd5-8eb0-2aa481bace7d req-642e5cfd-a7c0-42c9-b3fc-0ac0145d69b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a258c3-e36f-4542-bef5-586c66bb0e15", "tag": "880f98df-d8a5-4578-a7a6-a37e254c889d"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:35:05.332158 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-673bbeb7-6fa3-4cd5-8eb0-2aa481bace7d req-642e5cfd-a7c0-42c9-b3fc-0ac0145d69b1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:05.332858 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-673bbeb7-6fa3-4cd5-8eb0-2aa481bace7d req-642e5cfd-a7c0-42c9-b3fc-0ac0145d69b1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:05.364801 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-673bbeb7-6fa3-4cd5-8eb0-2aa481bace7d req-642e5cfd-a7c0-42c9-b3fc-0ac0145d69b1 service nova] Creating event network-changed:880f98df-d8a5-4578-a7a6-a37e254c889d for instance 98a258c3-e36f-4542-bef5-586c66bb0e15 on hv-cinder-84733 Jun 29 11:35:05.374051 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-673bbeb7-6fa3-4cd5-8eb0-2aa481bace7d req-642e5cfd-a7c0-42c9-b3fc-0ac0145d69b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056754 Jun 29 11:35:05.375929 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 455/910] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:35:05.991781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-86768b28-e74e-4f3e-bcfc-57561c1c1a95 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:05.992734 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-86768b28-e74e-4f3e-bcfc-57561c1c1a95 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:05.998918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:35:06.000858 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86768b28-e74e-4f3e-bcfc-57561c1c1a95 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:06.001300 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86768b28-e74e-4f3e-bcfc-57561c1c1a95 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:06.002190 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86768b28-e74e-4f3e-bcfc-57561c1c1a95 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:06.002639 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86768b28-e74e-4f3e-bcfc-57561c1c1a95 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:06.147602 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-86768b28-e74e-4f3e-bcfc-57561c1c1a95 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:06.155976 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-86768b28-e74e-4f3e-bcfc-57561c1c1a95 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:06.157476 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-86768b28-e74e-4f3e-bcfc-57561c1c1a95 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:06.158647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-86768b28-e74e-4f3e-bcfc-57561c1c1a95 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1740 microversion: 2.20 time: 0.171259 Jun 29 11:35:06.159205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 456/911] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:05 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:06.652058 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5ce0b73a-390a-4978-82d6-020892845be5 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] Action: 'create', calling method: .version_select at 0x7fd089583d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1531997641", "metadata": {"Type": "work"}}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:35:07.177253 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2ff2cc1c-ec56-4bf1-b465-79fec64dce85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:07.181586 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2ff2cc1c-ec56-4bf1-b465-79fec64dce85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:07.185114 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ff2cc1c-ec56-4bf1-b465-79fec64dce85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:07.185564 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ff2cc1c-ec56-4bf1-b465-79fec64dce85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:07.186326 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ff2cc1c-ec56-4bf1-b465-79fec64dce85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:07.186763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ff2cc1c-ec56-4bf1-b465-79fec64dce85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:07.201725 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:35:07.326981 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ff2cc1c-ec56-4bf1-b465-79fec64dce85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:07.336626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ff2cc1c-ec56-4bf1-b465-79fec64dce85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:07.338310 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ff2cc1c-ec56-4bf1-b465-79fec64dce85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:07.339482 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2ff2cc1c-ec56-4bf1-b465-79fec64dce85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1722 microversion: 2.20 time: 0.166609 Jun 29 11:35:07.340128 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 457/912] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:07 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:35:07.447397 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5ce0b73a-390a-4978-82d6-020892845be5 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.913241 Jun 29 11:35:07.448049 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 456/913] 10.222.0.44 () {60 vars in 1155 bytes} [Wed Jun 29 11:35:06 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 915 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 29 11:35:07.459454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f43d245c-503f-4b27-b783-ab15aaa31dff tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] Calling method '.version_select at 0x7fd08973b700>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:07.508051 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f43d245c-503f-4b27-b783-ab15aaa31dff tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e" status: 200 len: 353 microversion: 2.1 time: 0.052382 Jun 29 11:35:07.508622 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 458/914] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:35:07 2022] GET /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:35:08.363567 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0c313bba-bb64-420c-b43c-940f41a0443e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:08.364403 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0c313bba-bb64-420c-b43c-940f41a0443e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:08.371145 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c313bba-bb64-420c-b43c-940f41a0443e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:08.371648 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c313bba-bb64-420c-b43c-940f41a0443e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:08.372423 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c313bba-bb64-420c-b43c-940f41a0443e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:08.372851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c313bba-bb64-420c-b43c-940f41a0443e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:08.464105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-0ee3ca71-4687-47f0-b493-e5b275f17923 req-55aef741-f5f8-42f4-a1b2-d93e7e302fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d9da5-e4b3-407e-9b1d-4a33a8829015", "name": "network-vif-unplugged", "status": "completed", "tag": "85554f15-efa6-4d62-91fa-d1490f006424"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:35:08.473053 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0ee3ca71-4687-47f0-b493-e5b275f17923 req-55aef741-f5f8-42f4-a1b2-d93e7e302fc8 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:08.473496 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0ee3ca71-4687-47f0-b493-e5b275f17923 req-55aef741-f5f8-42f4-a1b2-d93e7e302fc8 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:08.485317 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-0ee3ca71-4687-47f0-b493-e5b275f17923 req-55aef741-f5f8-42f4-a1b2-d93e7e302fc8 service nova] Creating event network-vif-unplugged:85554f15-efa6-4d62-91fa-d1490f006424 for instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 on hv-cinder-84733 Jun 29 11:35:08.490375 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-0ee3ca71-4687-47f0-b493-e5b275f17923 req-55aef741-f5f8-42f4-a1b2-d93e7e302fc8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030428 Jun 29 11:35:08.492358 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 459/915] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:35:08.511784 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0c313bba-bb64-420c-b43c-940f41a0443e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:08.520095 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0c313bba-bb64-420c-b43c-940f41a0443e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:08.521635 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0c313bba-bb64-420c-b43c-940f41a0443e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:08.521918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1dc150b5-0625-4f6a-885f-08570954dc51 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] Calling method '.version_select at 0x7fd08973b550>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:08.522984 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0c313bba-bb64-420c-b43c-940f41a0443e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1722 microversion: 2.20 time: 0.163833 Jun 29 11:35:08.523539 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 457/916] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:08 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:08.570770 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1dc150b5-0625-4f6a-885f-08570954dc51 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e" status: 200 len: 354 microversion: 2.1 time: 0.053580 Jun 29 11:35:08.571346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 460/917] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:35:08 2022] GET /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:35:08.582299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3c5288e8-06b2-4673-b8d2-ad5b950a7817 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] Calling method '.version_select at 0x7fd089629e50>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:08.629424 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3c5288e8-06b2-4673-b8d2-ad5b950a7817 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e" status: 200 len: 354 microversion: 2.1 time: 0.050943 Jun 29 11:35:08.629971 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 458/918] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:35:08 2022] GET /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:35:08.654992 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-178337f2-215b-493e-af06-8e344ff379fd tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] Calling method '.version_select at 0x7fd08973bc10>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:08.844406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-178337f2-215b-493e-af06-8e344ff379fd tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e" status: 202 len: 0 microversion: 2.1 time: 0.193730 Jun 29 11:35:08.844985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 461/919] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jun 29 11:35:08 2022] DELETE /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:35:08.852969 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c619c71d-0946-4504-828f-23566563fb43 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] Calling method '.version_select at 0x7fd0894f5790>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:08.899025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c619c71d-0946-4504-828f-23566563fb43 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e" status: 200 len: 353 microversion: 2.1 time: 0.049841 Jun 29 11:35:08.899602 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 459/920] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:35:08 2022] GET /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:35:09.540678 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ad831201-c2d9-4be2-a806-277ffa909a07 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:09.541469 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ad831201-c2d9-4be2-a806-277ffa909a07 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:09.551239 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad831201-c2d9-4be2-a806-277ffa909a07 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:09.551701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad831201-c2d9-4be2-a806-277ffa909a07 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:09.552575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad831201-c2d9-4be2-a806-277ffa909a07 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:09.552958 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad831201-c2d9-4be2-a806-277ffa909a07 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:09.682919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ad831201-c2d9-4be2-a806-277ffa909a07 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:09.690933 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ad831201-c2d9-4be2-a806-277ffa909a07 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:09.696717 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ad831201-c2d9-4be2-a806-277ffa909a07 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:09.696717 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ad831201-c2d9-4be2-a806-277ffa909a07 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1725 microversion: 2.20 time: 0.156807 Jun 29 11:35:09.696717 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 462/921] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:09 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 11:35:09.712961 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-558fc739-731c-4d4f-b8f1-451c32a0c8cf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49802927-9f6d-4c94-9bb5-f7dc2c77e323"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:35:09.714061 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-558fc739-731c-4d4f-b8f1-451c32a0c8cf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:09.722737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-558fc739-731c-4d4f-b8f1-451c32a0c8cf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:09.725167 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-558fc739-731c-4d4f-b8f1-451c32a0c8cf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:09.725167 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-558fc739-731c-4d4f-b8f1-451c32a0c8cf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:09.725167 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-558fc739-731c-4d4f-b8f1-451c32a0c8cf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:09.911243 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1eeff093-fe37-4111-ba43-882ee1c0ee66 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] Calling method '.version_select at 0x7fd089717ca0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:09.939307 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-1eeff093-fe37-4111-ba43-882ee1c0ee66 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] HTTP exception thrown: Volume e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e could not be found. Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1eeff093-fe37-4111-ba43-882ee1c0ee66 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] Request method failure captured: Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e HTTP/1.1 Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDjquBd-w8Qyk-twcSJQ0LEeO-k8Fe4UrZn2QWEn1mmsMR4PUeKF0tam1_dtq5U0of6-mphPtJQL-ktNmMvbepTQCTAQW1aU1sOH3c44-mUNk9snEmyoSJJGsxjS0LP4pAYibWLFd5IgY4UVc0Gku1r8-kIIZs-ieYtnyY75z1OPRMg Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 49d52997dabc45fcb997fd4b6fa2a80e Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesGetTestJSON-847845198 Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:35:09.941387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/49d52997dabc45fcb997fd4b6fa2a80e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_49d52997dabc45fcb997fd4b6fa2a80e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/49d52997dabc45fcb997fd4b6fa2a80e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/49d52997dabc45fcb997fd4b6fa2a80e"}]}] Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesGetTestJSON-847845198 Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 49d52997dabc45fcb997fd4b6fa2a80e Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesGetTestJSON-847845198 Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesGetTestJSON-847845198-project Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 05d3d290d96a444a99406eaa51dbd3a0 Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesGetTestJSON-847845198-project Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Volume e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e could not be found. Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': 'e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e'} Jun 29 11:35:09.942999 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e could not be found. (HTTP 404) (Request-ID: req-6a975d60-d224-4525-8b19-a1ccf5006db6) Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:35:09.947324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 11:35:09.949209 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e could not be found. Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 11:35:09.950942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e could not be found. Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e could not be found. Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1eeff093-fe37-4111-ba43-882ee1c0ee66 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] Returning 404 to user: Volume e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1eeff093-fe37-4111-ba43-882ee1c0ee66 tempest-VolumesGetTestJSON-847845198 tempest-VolumesGetTestJSON-847845198-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e" status: 404 len: 109 microversion: 2.1 time: 0.035259 Jun 29 11:35:09.952177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 463/922] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:35:09 2022] GET /compute/v2.1/os-volumes/e575c2ca-2fb1-4e7f-b92c-fd9c8c42cc3e => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 11:35:10.692827 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-558fc739-731c-4d4f-b8f1-451c32a0c8cf tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "POST /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.984419 Jun 29 11:35:10.693676 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 460/923] 10.222.0.44 () {62 vars in 1363 bytes} [Wed Jun 29 11:35:09 2022] POST /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/os-volume_attachments => generated 188 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 11:35:10.811304 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e063d8d7-b19c-4459-93b4-5a56760d3824 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:10.811799 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e063d8d7-b19c-4459-93b4-5a56760d3824 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:10.818803 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e063d8d7-b19c-4459-93b4-5a56760d3824 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:10.819250 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e063d8d7-b19c-4459-93b4-5a56760d3824 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:10.820076 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e063d8d7-b19c-4459-93b4-5a56760d3824 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:10.820505 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e063d8d7-b19c-4459-93b4-5a56760d3824 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:11.415071 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e063d8d7-b19c-4459-93b4-5a56760d3824 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/os-volume_attachments/49802927-9f6d-4c94-9bb5-f7dc2c77e323" status: 202 len: 0 microversion: 2.20 time: 0.608071 Jun 29 11:35:11.415666 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 464/924] 10.222.0.44 () {60 vars in 1456 bytes} [Wed Jun 29 11:35:10 2022] DELETE /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/os-volume_attachments/49802927-9f6d-4c94-9bb5-f7dc2c77e323 => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:35:11.471144 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1e3a5d31-5e30-4710-a92a-0d50110a5a1b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:35:11.471751 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1e3a5d31-5e30-4710-a92a-0d50110a5a1b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:11.478867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e3a5d31-5e30-4710-a92a-0d50110a5a1b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:11.479310 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e3a5d31-5e30-4710-a92a-0d50110a5a1b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:11.480087 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e3a5d31-5e30-4710-a92a-0d50110a5a1b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:11.480521 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e3a5d31-5e30-4710-a92a-0d50110a5a1b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:11.721183 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1e3a5d31-5e30-4710-a92a-0d50110a5a1b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "POST /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/action" status: 202 len: 0 microversion: 2.20 time: 0.253797 Jun 29 11:35:11.723215 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 461/925] 10.222.0.44 () {62 vars in 1318 bytes} [Wed Jun 29 11:35:11 2022] POST /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:35:11.730247 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ca6aaa6a-ad0a-4567-b89e-74f0ed26d4a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:11.732022 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ca6aaa6a-ad0a-4567-b89e-74f0ed26d4a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:11.738552 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca6aaa6a-ad0a-4567-b89e-74f0ed26d4a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:11.739001 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca6aaa6a-ad0a-4567-b89e-74f0ed26d4a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:11.739964 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca6aaa6a-ad0a-4567-b89e-74f0ed26d4a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:11.740559 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca6aaa6a-ad0a-4567-b89e-74f0ed26d4a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:11.877667 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ca6aaa6a-ad0a-4567-b89e-74f0ed26d4a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:11.885930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ca6aaa6a-ad0a-4567-b89e-74f0ed26d4a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:11.887429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ca6aaa6a-ad0a-4567-b89e-74f0ed26d4a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:11.888706 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ca6aaa6a-ad0a-4567-b89e-74f0ed26d4a9 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1673 microversion: 2.20 time: 0.162464 Jun 29 11:35:11.893836 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 465/926] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:11 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:12.908223 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d4d2ba48-0586-47d1-8acf-2ff2c2ad9376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:12.908843 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d4d2ba48-0586-47d1-8acf-2ff2c2ad9376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:12.915691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4d2ba48-0586-47d1-8acf-2ff2c2ad9376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:12.918361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4d2ba48-0586-47d1-8acf-2ff2c2ad9376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:12.918361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4d2ba48-0586-47d1-8acf-2ff2c2ad9376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:12.918361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d4d2ba48-0586-47d1-8acf-2ff2c2ad9376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:13.061090 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d4d2ba48-0586-47d1-8acf-2ff2c2ad9376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:13.077604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d4d2ba48-0586-47d1-8acf-2ff2c2ad9376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:13.079315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d4d2ba48-0586-47d1-8acf-2ff2c2ad9376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:13.080802 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d4d2ba48-0586-47d1-8acf-2ff2c2ad9376 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1673 microversion: 2.20 time: 0.176922 Jun 29 11:35:13.081517 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 462/927] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:12 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:14.098452 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-83257658-4dc8-42ff-a423-bfd42f8eda4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:14.098976 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-83257658-4dc8-42ff-a423-bfd42f8eda4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:14.105494 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83257658-4dc8-42ff-a423-bfd42f8eda4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:14.106202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83257658-4dc8-42ff-a423-bfd42f8eda4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:14.106956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83257658-4dc8-42ff-a423-bfd42f8eda4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:14.107415 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83257658-4dc8-42ff-a423-bfd42f8eda4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:14.234047 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-83257658-4dc8-42ff-a423-bfd42f8eda4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:14.241956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-83257658-4dc8-42ff-a423-bfd42f8eda4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:14.243440 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-83257658-4dc8-42ff-a423-bfd42f8eda4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:14.244650 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-83257658-4dc8-42ff-a423-bfd42f8eda4d tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.150246 Jun 29 11:35:14.245203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 466/928] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:14 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:15.263382 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-26cf0af4-ebcd-4d73-9f08-3f4df07fe62a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:15.264022 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-26cf0af4-ebcd-4d73-9f08-3f4df07fe62a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:15.267180 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:35:15.271894 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26cf0af4-ebcd-4d73-9f08-3f4df07fe62a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:15.272371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26cf0af4-ebcd-4d73-9f08-3f4df07fe62a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:15.273090 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26cf0af4-ebcd-4d73-9f08-3f4df07fe62a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:15.273515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26cf0af4-ebcd-4d73-9f08-3f4df07fe62a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:15.413557 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-26cf0af4-ebcd-4d73-9f08-3f4df07fe62a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:15.422595 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-26cf0af4-ebcd-4d73-9f08-3f4df07fe62a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:15.424492 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-26cf0af4-ebcd-4d73-9f08-3f4df07fe62a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:15.425482 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-26cf0af4-ebcd-4d73-9f08-3f4df07fe62a tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.166239 Jun 29 11:35:15.426034 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 463/929] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:15 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:16.444939 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-114bd1cd-38c9-4d95-8add-68422af9c549 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:16.445570 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-114bd1cd-38c9-4d95-8add-68422af9c549 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:16.452834 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-114bd1cd-38c9-4d95-8add-68422af9c549 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:16.453277 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-114bd1cd-38c9-4d95-8add-68422af9c549 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:16.454027 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-114bd1cd-38c9-4d95-8add-68422af9c549 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:16.454475 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-114bd1cd-38c9-4d95-8add-68422af9c549 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:16.594330 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-114bd1cd-38c9-4d95-8add-68422af9c549 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:16.604306 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-114bd1cd-38c9-4d95-8add-68422af9c549 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:16.606997 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-114bd1cd-38c9-4d95-8add-68422af9c549 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:16.608241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-114bd1cd-38c9-4d95-8add-68422af9c549 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.167723 Jun 29 11:35:16.609140 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 467/930] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:16 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:17.627375 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8d9cc5ca-4033-44c8-aaf5-500388bb1227 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:17.628322 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8d9cc5ca-4033-44c8-aaf5-500388bb1227 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:17.635687 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d9cc5ca-4033-44c8-aaf5-500388bb1227 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:17.636493 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d9cc5ca-4033-44c8-aaf5-500388bb1227 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:17.637375 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d9cc5ca-4033-44c8-aaf5-500388bb1227 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:17.638439 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d9cc5ca-4033-44c8-aaf5-500388bb1227 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:17.817477 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8d9cc5ca-4033-44c8-aaf5-500388bb1227 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:17.825723 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8d9cc5ca-4033-44c8-aaf5-500388bb1227 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:17.827347 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8d9cc5ca-4033-44c8-aaf5-500388bb1227 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:17.832136 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8d9cc5ca-4033-44c8-aaf5-500388bb1227 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.205549 Jun 29 11:35:17.832136 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 464/931] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:17 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:18.846886 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c97f1018-c1d3-4a79-a617-f97df94a1ba7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:18.847586 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c97f1018-c1d3-4a79-a617-f97df94a1ba7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:18.854268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c97f1018-c1d3-4a79-a617-f97df94a1ba7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:18.854715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c97f1018-c1d3-4a79-a617-f97df94a1ba7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:18.855475 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c97f1018-c1d3-4a79-a617-f97df94a1ba7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:18.855934 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c97f1018-c1d3-4a79-a617-f97df94a1ba7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:18.995182 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c97f1018-c1d3-4a79-a617-f97df94a1ba7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:19.004687 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c97f1018-c1d3-4a79-a617-f97df94a1ba7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:19.006481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c97f1018-c1d3-4a79-a617-f97df94a1ba7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:19.007911 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c97f1018-c1d3-4a79-a617-f97df94a1ba7 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.165232 Jun 29 11:35:19.008972 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 468/932] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:18 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:20.026368 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9284ce08-1e14-4120-929a-2c46eae4aa6b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:20.027233 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9284ce08-1e14-4120-929a-2c46eae4aa6b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:20.035651 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9284ce08-1e14-4120-929a-2c46eae4aa6b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:20.036372 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9284ce08-1e14-4120-929a-2c46eae4aa6b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:20.037447 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9284ce08-1e14-4120-929a-2c46eae4aa6b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:20.037954 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9284ce08-1e14-4120-929a-2c46eae4aa6b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:20.171545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9284ce08-1e14-4120-929a-2c46eae4aa6b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:20.180538 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9284ce08-1e14-4120-929a-2c46eae4aa6b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:20.182347 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9284ce08-1e14-4120-929a-2c46eae4aa6b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:20.183518 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9284ce08-1e14-4120-929a-2c46eae4aa6b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.161098 Jun 29 11:35:20.184114 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 465/933] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:20 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:21.202644 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a12f1b5-2b37-4655-8488-6d01a154ea3e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:21.203288 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a12f1b5-2b37-4655-8488-6d01a154ea3e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:21.209872 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a12f1b5-2b37-4655-8488-6d01a154ea3e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:21.210520 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a12f1b5-2b37-4655-8488-6d01a154ea3e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:21.211305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a12f1b5-2b37-4655-8488-6d01a154ea3e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:21.211765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a12f1b5-2b37-4655-8488-6d01a154ea3e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:21.356527 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a12f1b5-2b37-4655-8488-6d01a154ea3e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:21.369560 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a12f1b5-2b37-4655-8488-6d01a154ea3e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:21.371073 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a12f1b5-2b37-4655-8488-6d01a154ea3e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:21.373661 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a12f1b5-2b37-4655-8488-6d01a154ea3e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.175355 Jun 29 11:35:21.374843 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 469/934] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:21 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:22.391890 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-10cd4972-46a4-45b9-ad7b-63c3e2bb497e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:22.392496 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-10cd4972-46a4-45b9-ad7b-63c3e2bb497e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:22.398619 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10cd4972-46a4-45b9-ad7b-63c3e2bb497e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:22.399057 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10cd4972-46a4-45b9-ad7b-63c3e2bb497e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:22.399802 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10cd4972-46a4-45b9-ad7b-63c3e2bb497e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:22.400255 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10cd4972-46a4-45b9-ad7b-63c3e2bb497e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:22.547961 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-10cd4972-46a4-45b9-ad7b-63c3e2bb497e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:22.561630 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-10cd4972-46a4-45b9-ad7b-63c3e2bb497e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:22.566229 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-10cd4972-46a4-45b9-ad7b-63c3e2bb497e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:22.566229 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-10cd4972-46a4-45b9-ad7b-63c3e2bb497e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.176900 Jun 29 11:35:22.566229 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 466/935] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:22 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:23.583755 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-24d486b0-f10d-4d72-a0da-101be2e8850f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:23.584445 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-24d486b0-f10d-4d72-a0da-101be2e8850f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:23.590592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24d486b0-f10d-4d72-a0da-101be2e8850f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:23.591038 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24d486b0-f10d-4d72-a0da-101be2e8850f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:23.592391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24d486b0-f10d-4d72-a0da-101be2e8850f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:23.592833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24d486b0-f10d-4d72-a0da-101be2e8850f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:23.728739 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-24d486b0-f10d-4d72-a0da-101be2e8850f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:23.746040 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-24d486b0-f10d-4d72-a0da-101be2e8850f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:23.757052 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-24d486b0-f10d-4d72-a0da-101be2e8850f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:23.757052 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-24d486b0-f10d-4d72-a0da-101be2e8850f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.170716 Jun 29 11:35:23.757052 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 470/936] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:23 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:24.768815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b914a6d8-0bda-48fa-bbc1-0abd7e093e1f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:24.770018 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b914a6d8-0bda-48fa-bbc1-0abd7e093e1f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:24.779593 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b914a6d8-0bda-48fa-bbc1-0abd7e093e1f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:24.780065 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b914a6d8-0bda-48fa-bbc1-0abd7e093e1f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:24.780824 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b914a6d8-0bda-48fa-bbc1-0abd7e093e1f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:24.781523 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b914a6d8-0bda-48fa-bbc1-0abd7e093e1f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:24.964544 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b914a6d8-0bda-48fa-bbc1-0abd7e093e1f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:24.973023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b914a6d8-0bda-48fa-bbc1-0abd7e093e1f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:24.974499 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b914a6d8-0bda-48fa-bbc1-0abd7e093e1f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:24.975630 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b914a6d8-0bda-48fa-bbc1-0abd7e093e1f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.210824 Jun 29 11:35:24.976272 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 467/937] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:24 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:25.993643 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7de1f925-7b8f-451b-9062-b6224023ccc1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:25.994258 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7de1f925-7b8f-451b-9062-b6224023ccc1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:26.001327 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7de1f925-7b8f-451b-9062-b6224023ccc1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:26.001954 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7de1f925-7b8f-451b-9062-b6224023ccc1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:26.002717 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7de1f925-7b8f-451b-9062-b6224023ccc1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:26.003171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7de1f925-7b8f-451b-9062-b6224023ccc1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:26.182044 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7de1f925-7b8f-451b-9062-b6224023ccc1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:26.191788 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7de1f925-7b8f-451b-9062-b6224023ccc1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:26.193720 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7de1f925-7b8f-451b-9062-b6224023ccc1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:26.195145 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7de1f925-7b8f-451b-9062-b6224023ccc1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.205506 Jun 29 11:35:26.195971 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 471/938] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:25 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:27.227690 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f6718c21-4bac-4096-be9c-594273bc068f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:27.228444 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f6718c21-4bac-4096-be9c-594273bc068f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:27.239129 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6718c21-4bac-4096-be9c-594273bc068f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:27.239540 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6718c21-4bac-4096-be9c-594273bc068f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:27.240350 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6718c21-4bac-4096-be9c-594273bc068f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:27.240970 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6718c21-4bac-4096-be9c-594273bc068f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:27.406437 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f6718c21-4bac-4096-be9c-594273bc068f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:27.416536 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f6718c21-4bac-4096-be9c-594273bc068f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:27.418056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f6718c21-4bac-4096-be9c-594273bc068f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:27.419698 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f6718c21-4bac-4096-be9c-594273bc068f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.208295 Jun 29 11:35:27.420290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 468/939] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:27 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:28.441072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8890febe-0997-4f65-b0e4-50af152f30d3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:28.441786 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8890febe-0997-4f65-b0e4-50af152f30d3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:28.456976 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8890febe-0997-4f65-b0e4-50af152f30d3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:28.457430 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8890febe-0997-4f65-b0e4-50af152f30d3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:28.458205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8890febe-0997-4f65-b0e4-50af152f30d3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:28.458639 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8890febe-0997-4f65-b0e4-50af152f30d3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:28.621422 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8890febe-0997-4f65-b0e4-50af152f30d3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:28.629481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8890febe-0997-4f65-b0e4-50af152f30d3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:28.631036 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8890febe-0997-4f65-b0e4-50af152f30d3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:28.632417 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8890febe-0997-4f65-b0e4-50af152f30d3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.195227 Jun 29 11:35:28.640688 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 472/940] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:28 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:29.650988 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6813057b-078c-4432-a2fe-d3258805ea42 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:29.651773 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6813057b-078c-4432-a2fe-d3258805ea42 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:29.658495 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6813057b-078c-4432-a2fe-d3258805ea42 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:29.659064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6813057b-078c-4432-a2fe-d3258805ea42 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:29.660084 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6813057b-078c-4432-a2fe-d3258805ea42 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:29.660597 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6813057b-078c-4432-a2fe-d3258805ea42 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:29.793355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6813057b-078c-4432-a2fe-d3258805ea42 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:29.801827 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6813057b-078c-4432-a2fe-d3258805ea42 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:29.803357 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6813057b-078c-4432-a2fe-d3258805ea42 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:29.804512 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6813057b-078c-4432-a2fe-d3258805ea42 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.157422 Jun 29 11:35:29.805411 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 469/941] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:29 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:30.353954 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:35:30.354416 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Wed Jun 29 11:35:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:35:30.822566 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4f13886d-8079-453d-a1bc-0a7d8e2551ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:30.823166 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4f13886d-8079-453d-a1bc-0a7d8e2551ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:30.829651 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f13886d-8079-453d-a1bc-0a7d8e2551ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:30.830092 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f13886d-8079-453d-a1bc-0a7d8e2551ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:30.830845 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f13886d-8079-453d-a1bc-0a7d8e2551ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:30.831276 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f13886d-8079-453d-a1bc-0a7d8e2551ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:30.968182 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4f13886d-8079-453d-a1bc-0a7d8e2551ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:30.976664 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4f13886d-8079-453d-a1bc-0a7d8e2551ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:30.978179 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4f13886d-8079-453d-a1bc-0a7d8e2551ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:30.979355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4f13886d-8079-453d-a1bc-0a7d8e2551ad tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.160717 Jun 29 11:35:30.979935 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 473/942] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:30 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:32.003914 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4cf0277a-e44f-4b87-b848-5fcdf2ff8d99 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:32.003914 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4cf0277a-e44f-4b87-b848-5fcdf2ff8d99 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:32.007165 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cf0277a-e44f-4b87-b848-5fcdf2ff8d99 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:32.007620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cf0277a-e44f-4b87-b848-5fcdf2ff8d99 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:32.008455 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cf0277a-e44f-4b87-b848-5fcdf2ff8d99 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:32.008916 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cf0277a-e44f-4b87-b848-5fcdf2ff8d99 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:32.385298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4cf0277a-e44f-4b87-b848-5fcdf2ff8d99 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:32.393317 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4cf0277a-e44f-4b87-b848-5fcdf2ff8d99 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:32.396226 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4cf0277a-e44f-4b87-b848-5fcdf2ff8d99 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:32.396226 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4cf0277a-e44f-4b87-b848-5fcdf2ff8d99 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.401678 Jun 29 11:35:32.396692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 470/943] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:31 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:33.414505 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-01aa0a0c-cc7d-490d-9636-ef9cb0c7bf5b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:33.415122 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-01aa0a0c-cc7d-490d-9636-ef9cb0c7bf5b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:33.422387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01aa0a0c-cc7d-490d-9636-ef9cb0c7bf5b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:33.422839 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01aa0a0c-cc7d-490d-9636-ef9cb0c7bf5b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:33.423611 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01aa0a0c-cc7d-490d-9636-ef9cb0c7bf5b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:33.425192 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01aa0a0c-cc7d-490d-9636-ef9cb0c7bf5b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:33.554479 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-01aa0a0c-cc7d-490d-9636-ef9cb0c7bf5b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:33.562792 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-01aa0a0c-cc7d-490d-9636-ef9cb0c7bf5b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:33.564324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-01aa0a0c-cc7d-490d-9636-ef9cb0c7bf5b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:33.565474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-01aa0a0c-cc7d-490d-9636-ef9cb0c7bf5b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.154876 Jun 29 11:35:33.566030 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 474/944] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:33 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:34.583587 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8fbde76e-a6eb-4df1-998b-6c061a1911ef tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:34.584221 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8fbde76e-a6eb-4df1-998b-6c061a1911ef tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:34.590770 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8fbde76e-a6eb-4df1-998b-6c061a1911ef tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:34.591219 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8fbde76e-a6eb-4df1-998b-6c061a1911ef tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:34.592512 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8fbde76e-a6eb-4df1-998b-6c061a1911ef tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:34.592951 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8fbde76e-a6eb-4df1-998b-6c061a1911ef tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:34.595471 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:35:34.860322 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8fbde76e-a6eb-4df1-998b-6c061a1911ef tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:34.860322 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8fbde76e-a6eb-4df1-998b-6c061a1911ef tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:34.860627 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8fbde76e-a6eb-4df1-998b-6c061a1911ef tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:34.860627 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8fbde76e-a6eb-4df1-998b-6c061a1911ef tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.177313 Jun 29 11:35:34.860627 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 471/945] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:34 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:35.778236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c6a1d0bf-78c5-4e5a-ac91-ba7c33cba10f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:35.778826 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c6a1d0bf-78c5-4e5a-ac91-ba7c33cba10f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:35.785805 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6a1d0bf-78c5-4e5a-ac91-ba7c33cba10f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:35.786254 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6a1d0bf-78c5-4e5a-ac91-ba7c33cba10f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:35.787216 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6a1d0bf-78c5-4e5a-ac91-ba7c33cba10f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:35.787799 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6a1d0bf-78c5-4e5a-ac91-ba7c33cba10f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:35.918406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c6a1d0bf-78c5-4e5a-ac91-ba7c33cba10f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:35.926935 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c6a1d0bf-78c5-4e5a-ac91-ba7c33cba10f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:35.928615 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c6a1d0bf-78c5-4e5a-ac91-ba7c33cba10f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:35.930562 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c6a1d0bf-78c5-4e5a-ac91-ba7c33cba10f tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.155985 Jun 29 11:35:35.931175 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 475/946] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:35 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:36.953465 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-669b3839-ec93-4879-b0e9-e754adbe04ce tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:36.953465 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-669b3839-ec93-4879-b0e9-e754adbe04ce tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:36.957482 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-669b3839-ec93-4879-b0e9-e754adbe04ce tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:36.957928 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-669b3839-ec93-4879-b0e9-e754adbe04ce tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:36.958701 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-669b3839-ec93-4879-b0e9-e754adbe04ce tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:36.959133 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-669b3839-ec93-4879-b0e9-e754adbe04ce tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:37.092274 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-669b3839-ec93-4879-b0e9-e754adbe04ce tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:37.101092 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-669b3839-ec93-4879-b0e9-e754adbe04ce tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:37.102590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-669b3839-ec93-4879-b0e9-e754adbe04ce tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:37.103739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-669b3839-ec93-4879-b0e9-e754adbe04ce tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.158617 Jun 29 11:35:37.104323 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 472/947] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:36 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:38.122435 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-920a5e25-979a-461c-9fbe-d56b26ca10a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:38.123274 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-920a5e25-979a-461c-9fbe-d56b26ca10a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:38.125393 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=32 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:35:38.130019 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-920a5e25-979a-461c-9fbe-d56b26ca10a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:38.130467 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-920a5e25-979a-461c-9fbe-d56b26ca10a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:38.131212 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-920a5e25-979a-461c-9fbe-d56b26ca10a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:38.131652 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-920a5e25-979a-461c-9fbe-d56b26ca10a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:38.134211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:35:38.270026 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-920a5e25-979a-461c-9fbe-d56b26ca10a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:38.278368 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-920a5e25-979a-461c-9fbe-d56b26ca10a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:38.279915 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-920a5e25-979a-461c-9fbe-d56b26ca10a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:38.281662 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-920a5e25-979a-461c-9fbe-d56b26ca10a0 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.163148 Jun 29 11:35:38.282221 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 476/948] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:38 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:39.300661 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c7392a60-6089-4124-aa52-ebf066ad045b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:39.301268 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c7392a60-6089-4124-aa52-ebf066ad045b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:39.307760 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7392a60-6089-4124-aa52-ebf066ad045b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:39.308229 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7392a60-6089-4124-aa52-ebf066ad045b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:39.308979 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7392a60-6089-4124-aa52-ebf066ad045b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:39.309415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7392a60-6089-4124-aa52-ebf066ad045b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:39.442360 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c7392a60-6089-4124-aa52-ebf066ad045b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:39.450745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c7392a60-6089-4124-aa52-ebf066ad045b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:39.452277 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c7392a60-6089-4124-aa52-ebf066ad045b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:39.453426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c7392a60-6089-4124-aa52-ebf066ad045b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.157268 Jun 29 11:35:39.453977 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 473/949] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:39 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:40.471056 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-90a893fe-4261-47a9-8fe3-58167ddaf577 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:40.471685 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-90a893fe-4261-47a9-8fe3-58167ddaf577 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:40.478586 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90a893fe-4261-47a9-8fe3-58167ddaf577 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:40.479018 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90a893fe-4261-47a9-8fe3-58167ddaf577 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:40.479788 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90a893fe-4261-47a9-8fe3-58167ddaf577 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:40.480264 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90a893fe-4261-47a9-8fe3-58167ddaf577 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:40.612109 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-90a893fe-4261-47a9-8fe3-58167ddaf577 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:40.620234 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-90a893fe-4261-47a9-8fe3-58167ddaf577 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:40.621744 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-90a893fe-4261-47a9-8fe3-58167ddaf577 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:40.622904 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-90a893fe-4261-47a9-8fe3-58167ddaf577 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.155782 Jun 29 11:35:40.623457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 477/950] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:40 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:41.642337 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-68b38db6-2eb2-467a-ac60-903e996eb8c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:41.642929 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-68b38db6-2eb2-467a-ac60-903e996eb8c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:41.650399 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68b38db6-2eb2-467a-ac60-903e996eb8c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:41.650855 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68b38db6-2eb2-467a-ac60-903e996eb8c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:41.651635 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68b38db6-2eb2-467a-ac60-903e996eb8c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:41.652129 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68b38db6-2eb2-467a-ac60-903e996eb8c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:41.786230 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-68b38db6-2eb2-467a-ac60-903e996eb8c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:41.794167 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-68b38db6-2eb2-467a-ac60-903e996eb8c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:41.795684 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-68b38db6-2eb2-467a-ac60-903e996eb8c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:41.796864 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-68b38db6-2eb2-467a-ac60-903e996eb8c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.159043 Jun 29 11:35:41.797957 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 474/951] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:41 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:42.815297 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ec7db138-9335-4826-b843-70e0c0274e52 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:42.815931 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ec7db138-9335-4826-b843-70e0c0274e52 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:42.822385 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec7db138-9335-4826-b843-70e0c0274e52 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:42.822833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec7db138-9335-4826-b843-70e0c0274e52 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:42.823601 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec7db138-9335-4826-b843-70e0c0274e52 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:42.824070 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec7db138-9335-4826-b843-70e0c0274e52 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:42.957507 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ec7db138-9335-4826-b843-70e0c0274e52 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:42.965763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ec7db138-9335-4826-b843-70e0c0274e52 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:42.967251 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ec7db138-9335-4826-b843-70e0c0274e52 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:42.968419 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ec7db138-9335-4826-b843-70e0c0274e52 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.157003 Jun 29 11:35:42.969582 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 478/952] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:42 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:43.987417 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ecf66a1d-30d3-4bdb-8941-79967b598d7c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:43.988083 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ecf66a1d-30d3-4bdb-8941-79967b598d7c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:43.994837 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ecf66a1d-30d3-4bdb-8941-79967b598d7c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:43.995277 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ecf66a1d-30d3-4bdb-8941-79967b598d7c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:43.996058 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ecf66a1d-30d3-4bdb-8941-79967b598d7c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:43.996488 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ecf66a1d-30d3-4bdb-8941-79967b598d7c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:44.124098 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ecf66a1d-30d3-4bdb-8941-79967b598d7c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:44.131953 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ecf66a1d-30d3-4bdb-8941-79967b598d7c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:44.133448 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ecf66a1d-30d3-4bdb-8941-79967b598d7c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:44.134579 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ecf66a1d-30d3-4bdb-8941-79967b598d7c tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.151719 Jun 29 11:35:44.135127 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 475/953] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:43 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:45.152766 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ecb2b80f-a9a9-4395-9db7-f9014083c710 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:45.153305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ecb2b80f-a9a9-4395-9db7-f9014083c710 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:45.159556 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecb2b80f-a9a9-4395-9db7-f9014083c710 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:45.160148 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecb2b80f-a9a9-4395-9db7-f9014083c710 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:45.160766 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecb2b80f-a9a9-4395-9db7-f9014083c710 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:45.161193 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecb2b80f-a9a9-4395-9db7-f9014083c710 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:45.301051 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ecb2b80f-a9a9-4395-9db7-f9014083c710 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:45.312706 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ecb2b80f-a9a9-4395-9db7-f9014083c710 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:45.316142 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ecb2b80f-a9a9-4395-9db7-f9014083c710 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:45.317354 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ecb2b80f-a9a9-4395-9db7-f9014083c710 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.168579 Jun 29 11:35:45.317905 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 479/954] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:45 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:46.335267 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fa6073b6-bb5d-434d-a338-6afdadfb9428 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:46.336134 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fa6073b6-bb5d-434d-a338-6afdadfb9428 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:46.338545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=26 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:35:46.343367 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa6073b6-bb5d-434d-a338-6afdadfb9428 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:46.344363 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa6073b6-bb5d-434d-a338-6afdadfb9428 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:46.345121 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa6073b6-bb5d-434d-a338-6afdadfb9428 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:46.345550 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa6073b6-bb5d-434d-a338-6afdadfb9428 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:46.476542 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fa6073b6-bb5d-434d-a338-6afdadfb9428 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:46.484673 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fa6073b6-bb5d-434d-a338-6afdadfb9428 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:46.486176 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fa6073b6-bb5d-434d-a338-6afdadfb9428 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:46.487308 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fa6073b6-bb5d-434d-a338-6afdadfb9428 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.155974 Jun 29 11:35:46.487881 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 476/955] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:46 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:46.780876 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-451af00f-8ee3-494c-95b9-84227d3be5ed req-f955129b-64f8-4af4-8d0c-cf39667dc9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d9da5-e4b3-407e-9b1d-4a33a8829015", "name": "network-vif-plugged", "status": "completed", "tag": "85554f15-efa6-4d62-91fa-d1490f006424"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:35:46.789413 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-451af00f-8ee3-494c-95b9-84227d3be5ed req-f955129b-64f8-4af4-8d0c-cf39667dc9f1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:46.789861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-451af00f-8ee3-494c-95b9-84227d3be5ed req-f955129b-64f8-4af4-8d0c-cf39667dc9f1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:46.800841 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-451af00f-8ee3-494c-95b9-84227d3be5ed req-f955129b-64f8-4af4-8d0c-cf39667dc9f1 service nova] Creating event network-vif-plugged:85554f15-efa6-4d62-91fa-d1490f006424 for instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 on hv-cinder-84733 Jun 29 11:35:46.805942 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-451af00f-8ee3-494c-95b9-84227d3be5ed req-f955129b-64f8-4af4-8d0c-cf39667dc9f1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148098 Jun 29 11:35:46.806633 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 480/956] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:35:47.505933 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bb41f6a8-395d-4477-a05b-ab5ffde0ccfd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:47.506544 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bb41f6a8-395d-4477-a05b-ab5ffde0ccfd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:47.512963 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb41f6a8-395d-4477-a05b-ab5ffde0ccfd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:47.513407 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb41f6a8-395d-4477-a05b-ab5ffde0ccfd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:47.514152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb41f6a8-395d-4477-a05b-ab5ffde0ccfd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:47.514583 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb41f6a8-395d-4477-a05b-ab5ffde0ccfd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:47.646462 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bb41f6a8-395d-4477-a05b-ab5ffde0ccfd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:47.654280 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bb41f6a8-395d-4477-a05b-ab5ffde0ccfd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:47.655775 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bb41f6a8-395d-4477-a05b-ab5ffde0ccfd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:47.656943 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bb41f6a8-395d-4477-a05b-ab5ffde0ccfd tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.154882 Jun 29 11:35:47.657495 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 477/957] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:47 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:48.676270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d81d3004-cabd-4997-a936-d2b7e9ebe849 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:48.676964 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d81d3004-cabd-4997-a936-d2b7e9ebe849 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:48.683054 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d81d3004-cabd-4997-a936-d2b7e9ebe849 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:48.683570 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d81d3004-cabd-4997-a936-d2b7e9ebe849 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:48.684419 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d81d3004-cabd-4997-a936-d2b7e9ebe849 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:48.684851 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d81d3004-cabd-4997-a936-d2b7e9ebe849 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:48.819672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d81d3004-cabd-4997-a936-d2b7e9ebe849 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:48.827559 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d81d3004-cabd-4997-a936-d2b7e9ebe849 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:48.829135 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d81d3004-cabd-4997-a936-d2b7e9ebe849 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:48.830285 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d81d3004-cabd-4997-a936-d2b7e9ebe849 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.158960 Jun 29 11:35:48.830834 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 481/958] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:48 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:49.848933 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-94136ac5-fcab-41f5-ac9c-e6097480a814 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:49.849543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-94136ac5-fcab-41f5-ac9c-e6097480a814 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:49.856125 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94136ac5-fcab-41f5-ac9c-e6097480a814 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:49.856572 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94136ac5-fcab-41f5-ac9c-e6097480a814 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:49.857603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94136ac5-fcab-41f5-ac9c-e6097480a814 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:49.858033 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94136ac5-fcab-41f5-ac9c-e6097480a814 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:49.990701 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-94136ac5-fcab-41f5-ac9c-e6097480a814 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:49.999401 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-94136ac5-fcab-41f5-ac9c-e6097480a814 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:50.001657 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-94136ac5-fcab-41f5-ac9c-e6097480a814 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:50.002901 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-94136ac5-fcab-41f5-ac9c-e6097480a814 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.157868 Jun 29 11:35:50.003848 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 478/959] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:49 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:51.020166 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1454fadb-ef47-42cd-a75a-ace2771cd417 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:51.020778 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1454fadb-ef47-42cd-a75a-ace2771cd417 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:51.027232 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1454fadb-ef47-42cd-a75a-ace2771cd417 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:51.027681 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1454fadb-ef47-42cd-a75a-ace2771cd417 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:51.028485 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1454fadb-ef47-42cd-a75a-ace2771cd417 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:51.028925 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1454fadb-ef47-42cd-a75a-ace2771cd417 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:51.163409 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1454fadb-ef47-42cd-a75a-ace2771cd417 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:51.171453 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1454fadb-ef47-42cd-a75a-ace2771cd417 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:51.173074 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1454fadb-ef47-42cd-a75a-ace2771cd417 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:51.174226 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1454fadb-ef47-42cd-a75a-ace2771cd417 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1731 microversion: 2.20 time: 0.158001 Jun 29 11:35:51.174779 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 482/960] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:51 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:35:52.193048 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0748606f-1339-4b10-8a59-e05e1db7d7a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:35:52.193731 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0748606f-1339-4b10-8a59-e05e1db7d7a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:35:52.200077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0748606f-1339-4b10-8a59-e05e1db7d7a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:52.200519 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0748606f-1339-4b10-8a59-e05e1db7d7a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:52.201265 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0748606f-1339-4b10-8a59-e05e1db7d7a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:35:52.201690 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0748606f-1339-4b10-8a59-e05e1db7d7a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:35:52.331291 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0748606f-1339-4b10-8a59-e05e1db7d7a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:52.339122 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0748606f-1339-4b10-8a59-e05e1db7d7a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:52.340686 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0748606f-1339-4b10-8a59-e05e1db7d7a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:35:52.341824 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0748606f-1339-4b10-8a59-e05e1db7d7a3 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1718 microversion: 2.20 time: 0.153437 Jun 29 11:35:52.342387 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 479/961] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:35:52 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:36:18.548502 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-987822b8-127f-4fd7-baf7-6f54a29e76b7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:18.578705 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-987822b8-127f-4fd7-baf7-6f54a29e76b7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:18.578705 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=13 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:36:18.578705 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=37 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:36:18.578705 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-987822b8-127f-4fd7-baf7-6f54a29e76b7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:18.578705 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-987822b8-127f-4fd7-baf7-6f54a29e76b7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:18.579198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-987822b8-127f-4fd7-baf7-6f54a29e76b7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:18.579198 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-987822b8-127f-4fd7-baf7-6f54a29e76b7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:18.581587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-987822b8-127f-4fd7-baf7-6f54a29e76b7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923/ips" status: 200 len: 150 microversion: 2.1 time: 0.037146 Jun 29 11:36:18.582143 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 483/962] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jun 29 11:36:18 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:36:18.593039 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f359a404-a777-47c3-9ec8-c8d12d6ae1af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6e17a5e-9fc4-4162-81ba-ec3361fffb05"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:36:18.594163 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f359a404-a777-47c3-9ec8-c8d12d6ae1af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:18.596761 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=7 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:36:18.597443 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=53 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:36:18.602153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f359a404-a777-47c3-9ec8-c8d12d6ae1af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:18.602597 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f359a404-a777-47c3-9ec8-c8d12d6ae1af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:18.603350 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f359a404-a777-47c3-9ec8-c8d12d6ae1af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:18.603780 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f359a404-a777-47c3-9ec8-c8d12d6ae1af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:18.681214 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-f359a404-a777-47c3-9ec8-c8d12d6ae1af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Invalid volume: volume e6e17a5e-9fc4-4162-81ba-ec3361fffb05 is already attached to instances: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f359a404-a777-47c3-9ec8-c8d12d6ae1af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: POST /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923/os-volume_attachments HTTP/1.1 Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 74 Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:36:18.682931 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:36:18.684628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:36:18.684628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:36:18.684628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:36:18.684628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:36:18.684628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:36:18.684628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:36:18.684628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:36:18.684628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:36:18.684628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:36:18.684628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Jun 29 11:36:18.684628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {"volumeAttachment": {"volumeId": "e6e17a5e-9fc4-4162-81ba-ec3361fffb05"}} Jun 29 11:36:18.684628 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Invalid volume: volume e6e17a5e-9fc4-4162-81ba-ec3361fffb05 is already attached to instances: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'server_id': '6bb83365-2340-4ffa-b755-a7cce647c923', 'body': {'volumeAttachment': {'volumeId': 'e6e17a5e-9fc4-4162-81ba-ec3361fffb05'}}} Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e6e17a5e-9fc4-4162-81ba-ec3361fffb05 is already attached to instances: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:18.685795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e6e17a5e-9fc4-4162-81ba-ec3361fffb05 is already attached to instances: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:18.687355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:18.689104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:18.689104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:36:18.689104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:36:18.689104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e6e17a5e-9fc4-4162-81ba-ec3361fffb05 is already attached to instances: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 Jun 29 11:36:18.689104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:18.689104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f359a404-a777-47c3-9ec8-c8d12d6ae1af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 400 to user: Invalid volume: volume e6e17a5e-9fc4-4162-81ba-ec3361fffb05 is already attached to instances: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:36:18.689104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f359a404-a777-47c3-9ec8-c8d12d6ae1af tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095349 Jun 29 11:36:18.689104 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 480/963] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:36:18 2022] POST /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 11:36:18.694022 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-31e22aaf-547c-4be1-8250-f79345ada4e8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:18.694544 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-31e22aaf-547c-4be1-8250-f79345ada4e8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:18.701165 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31e22aaf-547c-4be1-8250-f79345ada4e8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:18.701616 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31e22aaf-547c-4be1-8250-f79345ada4e8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:18.702385 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31e22aaf-547c-4be1-8250-f79345ada4e8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:18.702817 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31e22aaf-547c-4be1-8250-f79345ada4e8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:18.728700 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-31e22aaf-547c-4be1-8250-f79345ada4e8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:36:19.011773 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-31e22aaf-547c-4be1-8250-f79345ada4e8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 204 len: 0 microversion: 2.1 time: 0.322208 Jun 29 11:36:19.012401 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 484/964] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:36:18 2022] DELETE /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 11:36:19.020493 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d2ef0d3c-cd04-44ae-920e-0fe1b2b25d41 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:19.021195 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d2ef0d3c-cd04-44ae-920e-0fe1b2b25d41 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:19.028230 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2ef0d3c-cd04-44ae-920e-0fe1b2b25d41 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:19.028690 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2ef0d3c-cd04-44ae-920e-0fe1b2b25d41 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:19.029422 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2ef0d3c-cd04-44ae-920e-0fe1b2b25d41 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:19.029846 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2ef0d3c-cd04-44ae-920e-0fe1b2b25d41 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:19.156086 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d2ef0d3c-cd04-44ae-920e-0fe1b2b25d41 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:19.163955 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d2ef0d3c-cd04-44ae-920e-0fe1b2b25d41 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1682 microversion: 2.1 time: 0.147229 Jun 29 11:36:19.164515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 481/965] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:19 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:20.181681 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-831c8ddc-c5aa-417d-bd15-90bc976a0445 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:20.182294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-831c8ddc-c5aa-417d-bd15-90bc976a0445 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:20.188677 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-831c8ddc-c5aa-417d-bd15-90bc976a0445 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:20.189118 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-831c8ddc-c5aa-417d-bd15-90bc976a0445 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:20.189863 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-831c8ddc-c5aa-417d-bd15-90bc976a0445 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:20.190289 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-831c8ddc-c5aa-417d-bd15-90bc976a0445 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:20.321563 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-831c8ddc-c5aa-417d-bd15-90bc976a0445 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:20.328939 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-831c8ddc-c5aa-417d-bd15-90bc976a0445 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1682 microversion: 2.1 time: 0.151567 Jun 29 11:36:20.329497 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 485/966] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:20 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:21.345768 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bf97269a-e6c9-47f0-ac3b-ed5a7b1d72c2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:21.346370 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bf97269a-e6c9-47f0-ac3b-ed5a7b1d72c2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:21.353121 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf97269a-e6c9-47f0-ac3b-ed5a7b1d72c2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:21.353566 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf97269a-e6c9-47f0-ac3b-ed5a7b1d72c2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:21.354320 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf97269a-e6c9-47f0-ac3b-ed5a7b1d72c2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:21.354748 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf97269a-e6c9-47f0-ac3b-ed5a7b1d72c2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:21.481367 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bf97269a-e6c9-47f0-ac3b-ed5a7b1d72c2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:21.489318 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bf97269a-e6c9-47f0-ac3b-ed5a7b1d72c2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1682 microversion: 2.1 time: 0.147451 Jun 29 11:36:21.489882 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 482/967] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:21 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:21.807542 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-ef205e33-2610-4719-847f-e441260b2a1c req-ebce280f-6f61-40de-95da-61c1b16c1e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb83365-2340-4ffa-b755-a7cce647c923", "name": "network-vif-deleted", "tag": "da6dd2cc-508f-4c22-b3e8-3f9e6701a87e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:36:21.816493 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ef205e33-2610-4719-847f-e441260b2a1c req-ebce280f-6f61-40de-95da-61c1b16c1e16 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:21.817231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ef205e33-2610-4719-847f-e441260b2a1c req-ebce280f-6f61-40de-95da-61c1b16c1e16 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:21.829383 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-ef205e33-2610-4719-847f-e441260b2a1c req-ebce280f-6f61-40de-95da-61c1b16c1e16 service nova] Creating event network-vif-deleted:da6dd2cc-508f-4c22-b3e8-3f9e6701a87e for instance 6bb83365-2340-4ffa-b755-a7cce647c923 on hv-cinder-84733 Jun 29 11:36:21.834820 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-ef205e33-2610-4719-847f-e441260b2a1c req-ebce280f-6f61-40de-95da-61c1b16c1e16 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030965 Jun 29 11:36:21.835590 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 486/968] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:36:22.506885 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0f1ecfc1-332e-4477-8ee7-a556cba1ee94 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:22.507498 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0f1ecfc1-332e-4477-8ee7-a556cba1ee94 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:22.514752 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f1ecfc1-332e-4477-8ee7-a556cba1ee94 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:22.515212 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f1ecfc1-332e-4477-8ee7-a556cba1ee94 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:22.516037 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f1ecfc1-332e-4477-8ee7-a556cba1ee94 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:22.516467 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f1ecfc1-332e-4477-8ee7-a556cba1ee94 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:22.548605 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f1ecfc1-332e-4477-8ee7-a556cba1ee94 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:22.549043 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f1ecfc1-332e-4477-8ee7-a556cba1ee94 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:22.549478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-0f1ecfc1-332e-4477-8ee7-a556cba1ee94 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lazy-loading 'fault' on Instance uuid 6bb83365-2340-4ffa-b755-a7cce647c923 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:36:22.590464 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0f1ecfc1-332e-4477-8ee7-a556cba1ee94 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:22.598206 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0f1ecfc1-332e-4477-8ee7-a556cba1ee94 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 200 len: 1332 microversion: 2.1 time: 0.095329 Jun 29 11:36:22.599422 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 483/969] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:22 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:23.616767 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b6425fe0-078d-4a54-9966-46b19928e722 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:23.617392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b6425fe0-078d-4a54-9966-46b19928e722 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:23.623725 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6425fe0-078d-4a54-9966-46b19928e722 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:23.624201 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6425fe0-078d-4a54-9966-46b19928e722 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:23.624957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6425fe0-078d-4a54-9966-46b19928e722 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:23.625395 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6425fe0-078d-4a54-9966-46b19928e722 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:23.638664 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-b6425fe0-078d-4a54-9966-46b19928e722 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b6425fe0-078d-4a54-9966-46b19928e722 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 HTTP/1.1 Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:36:23.640305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:36:23.641867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:36:23.641867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:36:23.641867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:36:23.641867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:36:23.641867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:36:23.641867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:36:23.641867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:36:23.641867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:36:23.641867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:36:23.641867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:36:23.641867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:36:23.641867 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '6bb83365-2340-4ffa-b755-a7cce647c923'} Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:36:23.642811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:36:23.644355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:23.645882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b6425fe0-078d-4a54-9966-46b19928e722 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 404 to user: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:36:23.645882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b6425fe0-078d-4a54-9966-46b19928e722 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 404 len: 111 microversion: 2.1 time: 0.029847 Jun 29 11:36:23.645882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 487/970] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:23 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:36:23.650636 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4ed4a019-5ff0-4a72-b626-3fcf1d3ef253 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '.version_select at 0x7fd089507040>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:23.725073 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4ed4a019-5ff0-4a72-b626-3fcf1d3ef253 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1184600714" status: 202 len: 0 microversion: 2.1 time: 0.078325 Jun 29 11:36:23.725627 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 484/971] 10.222.0.44 () {58 vars in 1220 bytes} [Wed Jun 29 11:36:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1184600714 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 11:36:24.485123 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3b48d6cd-5b15-4391-9e9a-88d6dd536817 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:24.485619 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3b48d6cd-5b15-4391-9e9a-88d6dd536817 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:24.491583 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b48d6cd-5b15-4391-9e9a-88d6dd536817 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:24.492066 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b48d6cd-5b15-4391-9e9a-88d6dd536817 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:24.492822 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b48d6cd-5b15-4391-9e9a-88d6dd536817 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:24.493259 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b48d6cd-5b15-4391-9e9a-88d6dd536817 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:24.571295 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-3b48d6cd-5b15-4391-9e9a-88d6dd536817 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lazy-loading 'services' on Instance uuid e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:36:24.771333 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3b48d6cd-5b15-4391-9e9a-88d6dd536817 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/os-volume_attachments/e6e17a5e-9fc4-4162-81ba-ec3361fffb05" status: 202 len: 0 microversion: 2.1 time: 0.290185 Jun 29 11:36:24.772116 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 488/972] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jun 29 11:36:24 2022] DELETE /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/os-volume_attachments/e6e17a5e-9fc4-4162-81ba-ec3361fffb05 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:36:24.780611 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-18d5c66f-fbca-4198-8b50-9fad16cf11ce tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:24.781518 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-18d5c66f-fbca-4198-8b50-9fad16cf11ce tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:24.788380 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-18d5c66f-fbca-4198-8b50-9fad16cf11ce tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:24.792576 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-18d5c66f-fbca-4198-8b50-9fad16cf11ce tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:24.792576 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-18d5c66f-fbca-4198-8b50-9fad16cf11ce tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:24.792576 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-18d5c66f-fbca-4198-8b50-9fad16cf11ce tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:24.820055 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-18d5c66f-fbca-4198-8b50-9fad16cf11ce tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043829 Jun 29 11:36:24.820595 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 485/973] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:36:24 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:36:25.832329 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-58023d93-585a-4db6-b30c-4c513fbf75a4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:25.833234 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-58023d93-585a-4db6-b30c-4c513fbf75a4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:25.839861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58023d93-585a-4db6-b30c-4c513fbf75a4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:25.840319 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58023d93-585a-4db6-b30c-4c513fbf75a4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:25.841068 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58023d93-585a-4db6-b30c-4c513fbf75a4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:25.841495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58023d93-585a-4db6-b30c-4c513fbf75a4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:25.870898 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-58023d93-585a-4db6-b30c-4c513fbf75a4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043050 Jun 29 11:36:25.871438 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 489/974] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:36:25 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:36:26.883032 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b5fe0423-9148-4d44-ba55-7a1d6f0d6604 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:26.883891 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b5fe0423-9148-4d44-ba55-7a1d6f0d6604 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:26.890321 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b5fe0423-9148-4d44-ba55-7a1d6f0d6604 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:26.890798 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b5fe0423-9148-4d44-ba55-7a1d6f0d6604 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:26.891551 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b5fe0423-9148-4d44-ba55-7a1d6f0d6604 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:26.892017 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b5fe0423-9148-4d44-ba55-7a1d6f0d6604 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:26.920279 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b5fe0423-9148-4d44-ba55-7a1d6f0d6604 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041779 Jun 29 11:36:26.921407 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 486/975] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:36:26 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 11:36:26.977604 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-049381a5-72f5-4398-b927-bdd543332979 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:26.978100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-049381a5-72f5-4398-b927-bdd543332979 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:26.984950 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-049381a5-72f5-4398-b927-bdd543332979 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:26.985400 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-049381a5-72f5-4398-b927-bdd543332979 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:26.986162 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-049381a5-72f5-4398-b927-bdd543332979 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:26.986601 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-049381a5-72f5-4398-b927-bdd543332979 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:27.013526 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-049381a5-72f5-4398-b927-bdd543332979 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:36:27.255708 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-049381a5-72f5-4398-b927-bdd543332979 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 204 len: 0 microversion: 2.1 time: 0.281639 Jun 29 11:36:27.256895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 490/976] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:36:26 2022] DELETE /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:36:27.265062 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-88576a3e-8ed1-4c54-a4bc-a2e5ec4ec0d4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:27.265674 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-88576a3e-8ed1-4c54-a4bc-a2e5ec4ec0d4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:27.271589 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88576a3e-8ed1-4c54-a4bc-a2e5ec4ec0d4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:27.273989 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88576a3e-8ed1-4c54-a4bc-a2e5ec4ec0d4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:27.274779 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88576a3e-8ed1-4c54-a4bc-a2e5ec4ec0d4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:27.275664 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88576a3e-8ed1-4c54-a4bc-a2e5ec4ec0d4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:27.414378 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-88576a3e-8ed1-4c54-a4bc-a2e5ec4ec0d4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:27.421848 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-88576a3e-8ed1-4c54-a4bc-a2e5ec4ec0d4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1683 microversion: 2.1 time: 0.160664 Jun 29 11:36:27.422412 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 487/977] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:27 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:28.440008 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-68064388-cbf1-4bf3-95b1-c0cbebf1242c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:28.440734 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-68064388-cbf1-4bf3-95b1-c0cbebf1242c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:28.447093 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68064388-cbf1-4bf3-95b1-c0cbebf1242c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:28.447537 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68064388-cbf1-4bf3-95b1-c0cbebf1242c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:28.448312 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68064388-cbf1-4bf3-95b1-c0cbebf1242c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:28.448744 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68064388-cbf1-4bf3-95b1-c0cbebf1242c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:28.578292 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-68064388-cbf1-4bf3-95b1-c0cbebf1242c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:28.586213 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-68064388-cbf1-4bf3-95b1-c0cbebf1242c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1683 microversion: 2.1 time: 0.150412 Jun 29 11:36:28.586765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 491/978] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:28 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:29.603175 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bee8f8b5-82be-4cb8-8152-01804013f30b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:29.603898 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bee8f8b5-82be-4cb8-8152-01804013f30b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:29.611276 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bee8f8b5-82be-4cb8-8152-01804013f30b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:29.611726 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bee8f8b5-82be-4cb8-8152-01804013f30b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:29.612535 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bee8f8b5-82be-4cb8-8152-01804013f30b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:29.612972 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bee8f8b5-82be-4cb8-8152-01804013f30b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:29.755494 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bee8f8b5-82be-4cb8-8152-01804013f30b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:29.763694 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bee8f8b5-82be-4cb8-8152-01804013f30b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1683 microversion: 2.1 time: 0.164291 Jun 29 11:36:29.764302 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 488/979] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:29 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:30.422437 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-3e22f05f-5ab5-4dd3-9b6a-c821141a2ef0 req-600cce67-d70e-4e37-9c8c-47b468e72a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858", "name": "network-vif-deleted", "tag": "2cf96133-2999-42a7-a7e8-23dae89812c7"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:36:30.431774 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3e22f05f-5ab5-4dd3-9b6a-c821141a2ef0 req-600cce67-d70e-4e37-9c8c-47b468e72a7a service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:30.433346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3e22f05f-5ab5-4dd3-9b6a-c821141a2ef0 req-600cce67-d70e-4e37-9c8c-47b468e72a7a service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:30.443751 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-3e22f05f-5ab5-4dd3-9b6a-c821141a2ef0 req-600cce67-d70e-4e37-9c8c-47b468e72a7a service nova] Creating event network-vif-deleted:2cf96133-2999-42a7-a7e8-23dae89812c7 for instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 on hv-cinder-84733 Jun 29 11:36:30.448977 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-3e22f05f-5ab5-4dd3-9b6a-c821141a2ef0 req-600cce67-d70e-4e37-9c8c-47b468e72a7a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030189 Jun 29 11:36:30.449872 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 492/980] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:36:30.781604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c149f546-b41f-4afd-b159-4b7345533d45 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:30.782215 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c149f546-b41f-4afd-b159-4b7345533d45 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:30.789631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c149f546-b41f-4afd-b159-4b7345533d45 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:30.790072 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c149f546-b41f-4afd-b159-4b7345533d45 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:30.790831 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c149f546-b41f-4afd-b159-4b7345533d45 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:30.791278 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c149f546-b41f-4afd-b159-4b7345533d45 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:30.973932 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c149f546-b41f-4afd-b159-4b7345533d45 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:30.974372 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c149f546-b41f-4afd-b159-4b7345533d45 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:30.974844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-c149f546-b41f-4afd-b159-4b7345533d45 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lazy-loading 'fault' on Instance uuid e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:36:31.015052 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c149f546-b41f-4afd-b159-4b7345533d45 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:31.022386 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c149f546-b41f-4afd-b159-4b7345533d45 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 200 len: 1332 microversion: 2.1 time: 0.244858 Jun 29 11:36:31.022941 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 489/981] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:30 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 1332 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:32.039560 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b1c91736-96f5-407f-9880-16075d3336f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:32.040290 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b1c91736-96f5-407f-9880-16075d3336f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:32.046402 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1c91736-96f5-407f-9880-16075d3336f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:32.046841 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1c91736-96f5-407f-9880-16075d3336f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:32.047588 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1c91736-96f5-407f-9880-16075d3336f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:32.048053 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1c91736-96f5-407f-9880-16075d3336f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:32.060963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-b1c91736-96f5-407f-9880-16075d3336f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b1c91736-96f5-407f-9880-16075d3336f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 HTTP/1.1 Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:36:32.062592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:36:32.064214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:36:32.064214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:36:32.064214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:36:32.064214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:36:32.064214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:36:32.064214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:36:32.064214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:36:32.064214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:36:32.064214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:36:32.064214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:36:32.064214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:36:32.064214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': 'e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858'} Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:36:32.065110 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:36:32.066384 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:32.067597 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b1c91736-96f5-407f-9880-16075d3336f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 404 to user: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:36:32.067597 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b1c91736-96f5-407f-9880-16075d3336f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 404 len: 111 microversion: 2.1 time: 0.029076 Jun 29 11:36:32.067597 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 493/982] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:32 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:36:32.073732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-404a7dde-9ab8-4a4c-9720-7b8c73f85b54 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '.version_select at 0x7fd0894deaf0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:32.133066 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-404a7dde-9ab8-4a4c-9720-7b8c73f85b54 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466478267" status: 202 len: 0 microversion: 2.1 time: 0.063251 Jun 29 11:36:32.133535 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 490/983] 10.222.0.44 () {58 vars in 1220 bytes} [Wed Jun 29 11:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466478267 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:36:32.891645 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-93d06536-ef0e-478b-951d-781cde22b744 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: .version_select at 0x7fd08994d790>, body: {"keypair": {"name": "tempest-keypair-1844120252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdkEvr9QogXVKq9lof3DzBU6JWqaUYs8pLcbqhJOsoj7To6wMpDBOYkRhHwOupLLVaFQYh+Nve+egnKjt/ruDD9kn80qX1ooHp30lIVKOuZI4U+pLoE0DQBCAGKHhQWEg=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:36:32.906064 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-93d06536-ef0e-478b-951d-781cde22b744 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:36:32.910038 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-93d06536-ef0e-478b-951d-781cde22b744 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for user cf7bc4681c954c158a7051046bd9aa47 and project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:36:32.984712 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-93d06536-ef0e-478b-951d-781cde22b744 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097028 Jun 29 11:36:32.985319 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 494/984] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jun 29 11:36:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:36:35.104384 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1885079860", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42f5ddc9-93c3-4cb7-9c4a-2481dc4d5579"}], "security_groups": [{"name": "tempest-securitygroup--1527652681"}], "key_name": "tempest-keypair-1844120252", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:36:35.205218 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] validate_networks() for [('42f5ddc9-93c3-4cb7-9c4a-2481dc4d5579', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:36:35.675846 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:36:35.676266 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:36:35.676747 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:36:35.677145 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:36:35.677547 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:36:35.686313 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:35.686751 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:35.687529 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:35.687989 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:35.705083 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:36:35.708913 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for user cf7bc4681c954c158a7051046bd9aa47 and project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:36:35.720032 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:36:35.722229 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:36:35.860456 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a2afc112-e369-4b15-a065-66225ed19d72 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.761191 Jun 29 11:36:35.866039 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 491/985] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:36:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:36:35.871451 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7989b27e-9482-4347-a5db-46a5ebfa799e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:35.872394 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7989b27e-9482-4347-a5db-46a5ebfa799e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:35.943398 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7989b27e-9482-4347-a5db-46a5ebfa799e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:35.951609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7989b27e-9482-4347-a5db-46a5ebfa799e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1242 microversion: 2.1 time: 0.084067 Jun 29 11:36:35.952305 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 495/986] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:35 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:36.969092 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1b46624c-118f-448e-b35a-e1a9f04bb8f4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:36.969706 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1b46624c-118f-448e-b35a-e1a9f04bb8f4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:36.976541 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1b46624c-118f-448e-b35a-e1a9f04bb8f4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:36.976991 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1b46624c-118f-448e-b35a-e1a9f04bb8f4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:36.977753 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1b46624c-118f-448e-b35a-e1a9f04bb8f4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:36.978189 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1b46624c-118f-448e-b35a-e1a9f04bb8f4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:37.041176 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1b46624c-118f-448e-b35a-e1a9f04bb8f4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:37.048574 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1b46624c-118f-448e-b35a-e1a9f04bb8f4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1246 microversion: 2.1 time: 0.083805 Jun 29 11:36:37.049070 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 492/987] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:36 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:38.065513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2aa88097-713a-4385-88f4-0bdb19f1ea56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:38.066153 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2aa88097-713a-4385-88f4-0bdb19f1ea56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:38.073160 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2aa88097-713a-4385-88f4-0bdb19f1ea56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:38.073607 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2aa88097-713a-4385-88f4-0bdb19f1ea56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:38.074672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2aa88097-713a-4385-88f4-0bdb19f1ea56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:38.075284 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2aa88097-713a-4385-88f4-0bdb19f1ea56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:38.137282 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2aa88097-713a-4385-88f4-0bdb19f1ea56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:38.144613 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2aa88097-713a-4385-88f4-0bdb19f1ea56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1312 microversion: 2.1 time: 0.083117 Jun 29 11:36:38.145168 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 496/988] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:38 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1312 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:39.164936 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ff3a30c0-d1dc-4630-ba46-432b66c7aaa8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:39.165649 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ff3a30c0-d1dc-4630-ba46-432b66c7aaa8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:39.172344 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff3a30c0-d1dc-4630-ba46-432b66c7aaa8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:39.172855 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff3a30c0-d1dc-4630-ba46-432b66c7aaa8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:39.173619 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff3a30c0-d1dc-4630-ba46-432b66c7aaa8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:39.174048 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff3a30c0-d1dc-4630-ba46-432b66c7aaa8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:39.302618 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ff3a30c0-d1dc-4630-ba46-432b66c7aaa8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:39.314902 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ff3a30c0-d1dc-4630-ba46-432b66c7aaa8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1368 microversion: 2.1 time: 0.153774 Jun 29 11:36:39.315476 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 493/989] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:39 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:39.739067 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-b367afa4-771e-427c-b6c5-63ee94fa08fd req-ae14bedb-6fa6-4827-9bae-df7e003ddd87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2", "tag": "4430f461-9cb7-4ecb-a22c-a47394a7322a"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:36:39.752539 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b367afa4-771e-427c-b6c5-63ee94fa08fd req-ae14bedb-6fa6-4827-9bae-df7e003ddd87 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:39.752989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b367afa4-771e-427c-b6c5-63ee94fa08fd req-ae14bedb-6fa6-4827-9bae-df7e003ddd87 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:39.766202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-b367afa4-771e-427c-b6c5-63ee94fa08fd req-ae14bedb-6fa6-4827-9bae-df7e003ddd87 service nova] Creating event network-changed:4430f461-9cb7-4ecb-a22c-a47394a7322a for instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 on hv-cinder-84733 Jun 29 11:36:39.771139 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-b367afa4-771e-427c-b6c5-63ee94fa08fd req-ae14bedb-6fa6-4827-9bae-df7e003ddd87 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036273 Jun 29 11:36:39.773262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 497/990] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:36:40.334094 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-34c8955e-56f9-4347-933a-bda99fb9d73f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:40.335398 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-34c8955e-56f9-4347-933a-bda99fb9d73f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:40.341836 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34c8955e-56f9-4347-933a-bda99fb9d73f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:40.342284 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34c8955e-56f9-4347-933a-bda99fb9d73f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:40.343081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34c8955e-56f9-4347-933a-bda99fb9d73f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:40.343518 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34c8955e-56f9-4347-933a-bda99fb9d73f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:40.476599 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-34c8955e-56f9-4347-933a-bda99fb9d73f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:40.484381 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-34c8955e-56f9-4347-933a-bda99fb9d73f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1368 microversion: 2.1 time: 0.154120 Jun 29 11:36:40.484932 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 494/991] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:40 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:41.502617 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-71ca910c-4926-4d5e-9a83-be6fdd569978 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:41.503311 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-71ca910c-4926-4d5e-9a83-be6fdd569978 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:41.509562 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71ca910c-4926-4d5e-9a83-be6fdd569978 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:41.510009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71ca910c-4926-4d5e-9a83-be6fdd569978 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:41.510765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71ca910c-4926-4d5e-9a83-be6fdd569978 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:41.511197 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71ca910c-4926-4d5e-9a83-be6fdd569978 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:41.640367 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-71ca910c-4926-4d5e-9a83-be6fdd569978 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:41.648715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-71ca910c-4926-4d5e-9a83-be6fdd569978 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1368 microversion: 2.1 time: 0.150734 Jun 29 11:36:41.649304 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 498/992] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:41 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:42.665322 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1bc4ee3c-94f6-476c-84a4-33c97b2f0e2e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:42.665935 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1bc4ee3c-94f6-476c-84a4-33c97b2f0e2e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:42.672419 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1bc4ee3c-94f6-476c-84a4-33c97b2f0e2e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:42.672891 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1bc4ee3c-94f6-476c-84a4-33c97b2f0e2e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:42.673643 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1bc4ee3c-94f6-476c-84a4-33c97b2f0e2e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:42.674078 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1bc4ee3c-94f6-476c-84a4-33c97b2f0e2e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:42.804138 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1bc4ee3c-94f6-476c-84a4-33c97b2f0e2e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:42.811418 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1bc4ee3c-94f6-476c-84a4-33c97b2f0e2e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1368 microversion: 2.1 time: 0.149968 Jun 29 11:36:42.812002 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 495/993] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:42 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:43.828684 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a5ae5f96-0c0e-4754-9b10-d1e6b01282f9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:43.829295 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a5ae5f96-0c0e-4754-9b10-d1e6b01282f9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:43.836510 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5ae5f96-0c0e-4754-9b10-d1e6b01282f9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:43.836961 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5ae5f96-0c0e-4754-9b10-d1e6b01282f9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:43.837723 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5ae5f96-0c0e-4754-9b10-d1e6b01282f9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:43.838150 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5ae5f96-0c0e-4754-9b10-d1e6b01282f9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:43.967712 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a5ae5f96-0c0e-4754-9b10-d1e6b01282f9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:43.975183 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a5ae5f96-0c0e-4754-9b10-d1e6b01282f9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1368 microversion: 2.1 time: 0.150401 Jun 29 11:36:43.975756 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 499/994] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:43 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:44.991475 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e21b60a1-8a2d-4444-9000-6d9d34b3c50a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:44.994959 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e21b60a1-8a2d-4444-9000-6d9d34b3c50a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:44.998669 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e21b60a1-8a2d-4444-9000-6d9d34b3c50a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:44.999119 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e21b60a1-8a2d-4444-9000-6d9d34b3c50a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:44.999907 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e21b60a1-8a2d-4444-9000-6d9d34b3c50a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:45.000348 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e21b60a1-8a2d-4444-9000-6d9d34b3c50a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:45.130839 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e21b60a1-8a2d-4444-9000-6d9d34b3c50a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:45.138452 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e21b60a1-8a2d-4444-9000-6d9d34b3c50a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1368 microversion: 2.1 time: 0.150728 Jun 29 11:36:45.139011 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 496/995] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:44 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:46.155490 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cd2311ef-6d82-4cdc-9393-9e683be5b280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:46.156121 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cd2311ef-6d82-4cdc-9393-9e683be5b280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:46.158485 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:36:46.163243 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd2311ef-6d82-4cdc-9393-9e683be5b280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:46.168303 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd2311ef-6d82-4cdc-9393-9e683be5b280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:46.168303 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd2311ef-6d82-4cdc-9393-9e683be5b280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:46.168303 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd2311ef-6d82-4cdc-9393-9e683be5b280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:46.294021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cd2311ef-6d82-4cdc-9393-9e683be5b280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:46.301261 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cd2311ef-6d82-4cdc-9393-9e683be5b280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1368 microversion: 2.1 time: 0.149601 Jun 29 11:36:46.301819 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 500/996] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:46 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:47.014615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-8f5edc33-e596-4659-b8c9-c9e607a9ea06 req-0b51a427-b87d-41f5-960f-da67e2a737c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2", "name": "network-vif-plugged", "status": "completed", "tag": "4430f461-9cb7-4ecb-a22c-a47394a7322a"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:36:47.018091 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:36:47.018761 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:36:47.024546 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-8f5edc33-e596-4659-b8c9-c9e607a9ea06 req-0b51a427-b87d-41f5-960f-da67e2a737c6 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:47.024990 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-8f5edc33-e596-4659-b8c9-c9e607a9ea06 req-0b51a427-b87d-41f5-960f-da67e2a737c6 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:47.036084 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-8f5edc33-e596-4659-b8c9-c9e607a9ea06 req-0b51a427-b87d-41f5-960f-da67e2a737c6 service nova] Creating event network-vif-plugged:4430f461-9cb7-4ecb-a22c-a47394a7322a for instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 on hv-cinder-84733 Jun 29 11:36:47.041665 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-8f5edc33-e596-4659-b8c9-c9e607a9ea06 req-0b51a427-b87d-41f5-960f-da67e2a737c6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030716 Jun 29 11:36:47.042268 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 497/997] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:36:47.322427 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fc207254-9b18-41d1-8a6f-0aabc5bb91cd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:47.323048 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fc207254-9b18-41d1-8a6f-0aabc5bb91cd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:47.329554 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc207254-9b18-41d1-8a6f-0aabc5bb91cd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:47.330006 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc207254-9b18-41d1-8a6f-0aabc5bb91cd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:47.330765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc207254-9b18-41d1-8a6f-0aabc5bb91cd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:47.331203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc207254-9b18-41d1-8a6f-0aabc5bb91cd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:47.335675 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:36:47.461288 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc207254-9b18-41d1-8a6f-0aabc5bb91cd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:47.468402 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fc207254-9b18-41d1-8a6f-0aabc5bb91cd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1368 microversion: 2.1 time: 0.149878 Jun 29 11:36:47.468956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 501/998] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:47 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:48.090364 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ae629381-4797-4210-8a8c-a2f767b29834 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:48.091355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ae629381-4797-4210-8a8c-a2f767b29834 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:48.097968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae629381-4797-4210-8a8c-a2f767b29834 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:48.098419 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae629381-4797-4210-8a8c-a2f767b29834 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:48.099176 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae629381-4797-4210-8a8c-a2f767b29834 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:48.099611 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae629381-4797-4210-8a8c-a2f767b29834 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:48.127583 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ae629381-4797-4210-8a8c-a2f767b29834 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042576 Jun 29 11:36:48.128151 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 498/999] 10.222.0.44 () {60 vars in 1342 bytes} [Wed Jun 29 11:36:48 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:48.184239 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e5a6a02d-aded-4b18-be03-59197c33bd36 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:48.184682 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5a6a02d-aded-4b18-be03-59197c33bd36 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:48.190540 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5a6a02d-aded-4b18-be03-59197c33bd36 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:48.190986 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5a6a02d-aded-4b18-be03-59197c33bd36 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:48.191742 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5a6a02d-aded-4b18-be03-59197c33bd36 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:48.192202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5a6a02d-aded-4b18-be03-59197c33bd36 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:48.216438 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5a6a02d-aded-4b18-be03-59197c33bd36 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:36:48.455083 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e5a6a02d-aded-4b18-be03-59197c33bd36 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 204 len: 0 microversion: 2.20 time: 0.274456 Jun 29 11:36:48.455805 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 502/1000] 10.222.0.44 () {60 vars in 1279 bytes} [Wed Jun 29 11:36:48 2022] DELETE /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 11:36:48.464299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a5f398f2-f5c8-477b-bf52-8d9dd77af56e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:48.464901 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a5f398f2-f5c8-477b-bf52-8d9dd77af56e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:48.470923 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5f398f2-f5c8-477b-bf52-8d9dd77af56e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:48.471371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5f398f2-f5c8-477b-bf52-8d9dd77af56e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:48.472157 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5f398f2-f5c8-477b-bf52-8d9dd77af56e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:48.472594 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5f398f2-f5c8-477b-bf52-8d9dd77af56e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:48.476580 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:36:48.486122 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7b99dc0d-f5d2-45a6-9325-dc6d92aee5e5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:48.486853 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7b99dc0d-f5d2-45a6-9325-dc6d92aee5e5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:48.493057 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b99dc0d-f5d2-45a6-9325-dc6d92aee5e5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:48.493538 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b99dc0d-f5d2-45a6-9325-dc6d92aee5e5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:48.495735 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b99dc0d-f5d2-45a6-9325-dc6d92aee5e5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:48.495735 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b99dc0d-f5d2-45a6-9325-dc6d92aee5e5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:48.655392 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a5f398f2-f5c8-477b-bf52-8d9dd77af56e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:48.663793 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a5f398f2-f5c8-477b-bf52-8d9dd77af56e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:48.665300 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a5f398f2-f5c8-477b-bf52-8d9dd77af56e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:48.666461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a5f398f2-f5c8-477b-bf52-8d9dd77af56e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.206051 Jun 29 11:36:48.667010 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 499/1001] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:36:48 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:36:48.677498 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7b99dc0d-f5d2-45a6-9325-dc6d92aee5e5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:48.685542 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7b99dc0d-f5d2-45a6-9325-dc6d92aee5e5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1368 microversion: 2.1 time: 0.203887 Jun 29 11:36:48.686105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 503/1002] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:48 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:36:49.684867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3921dd55-c464-46cf-a002-b91534f94a41 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:49.685460 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3921dd55-c464-46cf-a002-b91534f94a41 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:49.687735 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:36:49.692445 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3921dd55-c464-46cf-a002-b91534f94a41 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:49.692885 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3921dd55-c464-46cf-a002-b91534f94a41 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:49.694176 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3921dd55-c464-46cf-a002-b91534f94a41 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:49.694806 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3921dd55-c464-46cf-a002-b91534f94a41 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:49.701320 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d46dd26b-a7b8-47bb-9496-302d2ebcc280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:49.702059 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d46dd26b-a7b8-47bb-9496-302d2ebcc280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:49.704541 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:36:49.709349 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d46dd26b-a7b8-47bb-9496-302d2ebcc280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:49.709817 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d46dd26b-a7b8-47bb-9496-302d2ebcc280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:49.710580 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d46dd26b-a7b8-47bb-9496-302d2ebcc280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:49.711019 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d46dd26b-a7b8-47bb-9496-302d2ebcc280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:49.889513 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3921dd55-c464-46cf-a002-b91534f94a41 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:49.897385 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3921dd55-c464-46cf-a002-b91534f94a41 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:49.898877 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3921dd55-c464-46cf-a002-b91534f94a41 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:49.900101 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3921dd55-c464-46cf-a002-b91534f94a41 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.219239 Jun 29 11:36:49.900658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 500/1003] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:36:49 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:36:49.904018 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d46dd26b-a7b8-47bb-9496-302d2ebcc280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:49.911572 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d46dd26b-a7b8-47bb-9496-302d2ebcc280 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1368 microversion: 2.1 time: 0.214025 Jun 29 11:36:49.917391 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 504/1004] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:49 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:50.919159 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-343bcbc4-5456-4e8e-858c-78b41e818310 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:50.919898 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-343bcbc4-5456-4e8e-858c-78b41e818310 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:50.927344 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-343bcbc4-5456-4e8e-858c-78b41e818310 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:50.927344 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-343bcbc4-5456-4e8e-858c-78b41e818310 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:50.928752 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-343bcbc4-5456-4e8e-858c-78b41e818310 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:50.929517 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-343bcbc4-5456-4e8e-858c-78b41e818310 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:50.933261 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0aab7526-47be-4bdd-8f0f-812bb8db8df7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:50.933880 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0aab7526-47be-4bdd-8f0f-812bb8db8df7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:50.943223 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0aab7526-47be-4bdd-8f0f-812bb8db8df7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:50.945327 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0aab7526-47be-4bdd-8f0f-812bb8db8df7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:50.945327 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0aab7526-47be-4bdd-8f0f-812bb8db8df7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:50.945590 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0aab7526-47be-4bdd-8f0f-812bb8db8df7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:51.228969 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-343bcbc4-5456-4e8e-858c-78b41e818310 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:51.241344 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0aab7526-47be-4bdd-8f0f-812bb8db8df7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:51.254797 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-343bcbc4-5456-4e8e-858c-78b41e818310 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:51.257113 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-343bcbc4-5456-4e8e-858c-78b41e818310 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:51.261853 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0aab7526-47be-4bdd-8f0f-812bb8db8df7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1558 microversion: 2.1 time: 0.333127 Jun 29 11:36:51.262442 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 505/1005] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:36:50 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1558 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:36:51.263964 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-343bcbc4-5456-4e8e-858c-78b41e818310 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1724 microversion: 2.20 time: 0.349294 Jun 29 11:36:51.264725 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 501/1006] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:36:50 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:36:51.277902 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7cbe6f8c-2c45-4710-b2f4-907286cb8d12 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:51.284734 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7cbe6f8c-2c45-4710-b2f4-907286cb8d12 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:51.284734 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cbe6f8c-2c45-4710-b2f4-907286cb8d12 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:51.284959 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cbe6f8c-2c45-4710-b2f4-907286cb8d12 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:51.285703 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cbe6f8c-2c45-4710-b2f4-907286cb8d12 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:51.286327 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7cbe6f8c-2c45-4710-b2f4-907286cb8d12 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:51.405327 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7cbe6f8c-2c45-4710-b2f4-907286cb8d12 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131123 Jun 29 11:36:51.406145 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 506/1007] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jun 29 11:36:51 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:36:51.859518 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-609608d3-2cdc-4fcd-bf15-b4e9aff1b23a req-7d802805-e430-4c36-940a-35e90d9333b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d9da5-e4b3-407e-9b1d-4a33a8829015", "name": "network-vif-deleted", "tag": "85554f15-efa6-4d62-91fa-d1490f006424"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:36:51.867869 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-609608d3-2cdc-4fcd-bf15-b4e9aff1b23a req-7d802805-e430-4c36-940a-35e90d9333b8 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:51.869450 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-609608d3-2cdc-4fcd-bf15-b4e9aff1b23a req-7d802805-e430-4c36-940a-35e90d9333b8 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:51.880220 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-609608d3-2cdc-4fcd-bf15-b4e9aff1b23a req-7d802805-e430-4c36-940a-35e90d9333b8 service nova] Creating event network-vif-deleted:85554f15-efa6-4d62-91fa-d1490f006424 for instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 on hv-cinder-84733 Jun 29 11:36:51.885209 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-609608d3-2cdc-4fcd-bf15-b4e9aff1b23a req-7d802805-e430-4c36-940a-35e90d9333b8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029801 Jun 29 11:36:51.886005 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 502/1008] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:36:52.283407 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:52.284192 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:52.294882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:52.296201 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:52.299405 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:52.300122 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:52.338092 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:52.338587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:52.339039 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lazy-loading 'fault' on Instance uuid 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:36:52.383318 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:52.398271 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:52.399786 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '275df17696084dce9e7af487275bacab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a7eaf772c434e9e38a18430425895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:36:52.400979 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6efb5e3e-99a5-40ed-be5d-c067a5959234 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 200 len: 1371 microversion: 2.20 time: 0.122352 Jun 29 11:36:52.401548 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 507/1009] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:36:52 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 1371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 11:36:52.993582 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-f8955f99-43ae-450a-a0a6-54ff1ff4a50d req-925c19c8-7eca-4509-a2f4-827a623bf2ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2", "tag": "4430f461-9cb7-4ecb-a22c-a47394a7322a"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:36:53.002382 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f8955f99-43ae-450a-a0a6-54ff1ff4a50d req-925c19c8-7eca-4509-a2f4-827a623bf2ed service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:53.002823 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f8955f99-43ae-450a-a0a6-54ff1ff4a50d req-925c19c8-7eca-4509-a2f4-827a623bf2ed service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:53.019343 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-f8955f99-43ae-450a-a0a6-54ff1ff4a50d req-925c19c8-7eca-4509-a2f4-827a623bf2ed service nova] Creating event network-changed:4430f461-9cb7-4ecb-a22c-a47394a7322a for instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 on hv-cinder-84733 Jun 29 11:36:53.024640 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-f8955f99-43ae-450a-a0a6-54ff1ff4a50d req-925c19c8-7eca-4509-a2f4-827a623bf2ed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167588 Jun 29 11:36:53.025330 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 503/1010] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:36:53.421035 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-72aae702-3c6f-4a1a-95e7-fa28cca4db85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:53.422436 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-72aae702-3c6f-4a1a-95e7-fa28cca4db85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:53.430130 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72aae702-3c6f-4a1a-95e7-fa28cca4db85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:53.430860 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72aae702-3c6f-4a1a-95e7-fa28cca4db85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:53.431697 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72aae702-3c6f-4a1a-95e7-fa28cca4db85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:53.432360 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72aae702-3c6f-4a1a-95e7-fa28cca4db85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:53.446318 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-72aae702-3c6f-4a1a-95e7-fa28cca4db85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] HTTP exception thrown: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-72aae702-3c6f-4a1a-95e7-fa28cca4db85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Request method failure captured: Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 HTTP/1.1 Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDcJtqXZgTA5bnAtNLAViYu8KzbirrJvshhtBHvnHgq6za50BpQcslYYakTA3-uP91chtsP_XKm95_9nU3EV4CLN90PURAN-_0uEJKrmAX-2ThVGQOPDhdZZpK7YmkmmJBpGCjcuu1WY2HT6WVGtUjp6Sc_xl8eXENID5Ioj39zHAnU Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 364a7eaf772c434e9e38a18430425895 Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:36:53.448133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:36:53.449919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/364a7eaf772c434e9e38a18430425895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_364a7eaf772c434e9e38a18430425895", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/364a7eaf772c434e9e38a18430425895"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/364a7eaf772c434e9e38a18430425895"}]}] Jun 29 11:36:53.449919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:53.449919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 364a7eaf772c434e9e38a18430425895 Jun 29 11:36:53.449919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:53.449919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-499333534-project Jun 29 11:36:53.449919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:36:53.449919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:36:53.449919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 275df17696084dce9e7af487275bacab Jun 29 11:36:53.449919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-499333534-project Jun 29 11:36:53.449919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:36:53.449919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:53.449919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '2d4d9da5-e4b3-407e-9b1d-4a33a8829015'} Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:36:53.450870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:53.452489 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:53.454750 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-72aae702-3c6f-4a1a-95e7-fa28cca4db85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Returning 404 to user: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:36:53.454750 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-72aae702-3c6f-4a1a-95e7-fa28cca4db85 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 404 len: 111 microversion: 2.20 time: 0.033058 Jun 29 11:36:53.454750 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 508/1011] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:36:53 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 11:36:53.462564 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-815c523a-105e-487a-a6e6-2043d286672b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '.version_select at 0x7fd089530790>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:53.539563 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-815c523a-105e-487a-a6e6-2043d286672b tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384864845" status: 204 len: 0 microversion: 2.20 time: 0.081797 Jun 29 11:36:53.540296 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 504/1012] 10.222.0.44 () {60 vars in 1261 bytes} [Wed Jun 29 11:36:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384864845 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 11:36:55.584890 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-922456b0-7eb7-4e73-934e-0aed8fcdd80e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:55.585379 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-922456b0-7eb7-4e73-934e-0aed8fcdd80e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:55.591909 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-922456b0-7eb7-4e73-934e-0aed8fcdd80e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:55.592355 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-922456b0-7eb7-4e73-934e-0aed8fcdd80e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:55.593108 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-922456b0-7eb7-4e73-934e-0aed8fcdd80e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:55.593535 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-922456b0-7eb7-4e73-934e-0aed8fcdd80e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:55.606543 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-922456b0-7eb7-4e73-934e-0aed8fcdd80e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] HTTP exception thrown: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-922456b0-7eb7-4e73-934e-0aed8fcdd80e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Request method failure captured: Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 HTTP/1.1 Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDcJtqXZgTA5bnAtNLAViYu8KzbirrJvshhtBHvnHgq6za50BpQcslYYakTA3-uP91chtsP_XKm95_9nU3EV4CLN90PURAN-_0uEJKrmAX-2ThVGQOPDhdZZpK7YmkmmJBpGCjcuu1WY2HT6WVGtUjp6Sc_xl8eXENID5Ioj39zHAnU Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 364a7eaf772c434e9e38a18430425895 Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:36:55.608464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:36:55.610105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/364a7eaf772c434e9e38a18430425895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_364a7eaf772c434e9e38a18430425895", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/364a7eaf772c434e9e38a18430425895"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/364a7eaf772c434e9e38a18430425895"}]}] Jun 29 11:36:55.610105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:55.610105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 364a7eaf772c434e9e38a18430425895 Jun 29 11:36:55.610105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:55.610105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-499333534-project Jun 29 11:36:55.610105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:36:55.610105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:36:55.610105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 275df17696084dce9e7af487275bacab Jun 29 11:36:55.610105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-499333534-project Jun 29 11:36:55.610105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:36:55.610105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:55.610105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '2d4d9da5-e4b3-407e-9b1d-4a33a8829015'} Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:36:55.611009 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:55.612514 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:55.614224 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-922456b0-7eb7-4e73-934e-0aed8fcdd80e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Returning 404 to user: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:36:55.614224 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-922456b0-7eb7-4e73-934e-0aed8fcdd80e tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 404 len: 111 microversion: 2.20 time: 0.028811 Jun 29 11:36:55.614224 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 509/1013] 10.222.0.44 () {60 vars in 1279 bytes} [Wed Jun 29 11:36:55 2022] DELETE /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 11:36:55.619121 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d551045c-05f0-4d01-9713-b04dd7ec10c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:55.619894 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d551045c-05f0-4d01-9713-b04dd7ec10c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: 2d4d9da5-e4b3-407e-9b1d-4a33a8829015] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:55.626478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d551045c-05f0-4d01-9713-b04dd7ec10c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:55.626921 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d551045c-05f0-4d01-9713-b04dd7ec10c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:55.627669 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d551045c-05f0-4d01-9713-b04dd7ec10c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:55.628125 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d551045c-05f0-4d01-9713-b04dd7ec10c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:55.641363 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-d551045c-05f0-4d01-9713-b04dd7ec10c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] HTTP exception thrown: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d551045c-05f0-4d01-9713-b04dd7ec10c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Request method failure captured: Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 HTTP/1.1 Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDcJtqXZgTA5bnAtNLAViYu8KzbirrJvshhtBHvnHgq6za50BpQcslYYakTA3-uP91chtsP_XKm95_9nU3EV4CLN90PURAN-_0uEJKrmAX-2ThVGQOPDhdZZpK7YmkmmJBpGCjcuu1WY2HT6WVGtUjp6Sc_xl8eXENID5Ioj39zHAnU Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 364a7eaf772c434e9e38a18430425895 Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:36:55.642968 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:36:55.644615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/364a7eaf772c434e9e38a18430425895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_364a7eaf772c434e9e38a18430425895", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/364a7eaf772c434e9e38a18430425895"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/364a7eaf772c434e9e38a18430425895"}]}] Jun 29 11:36:55.644615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:55.644615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 364a7eaf772c434e9e38a18430425895 Jun 29 11:36:55.644615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:55.644615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeShelveTestJSON-499333534-project Jun 29 11:36:55.644615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:36:55.644615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:36:55.644615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 275df17696084dce9e7af487275bacab Jun 29 11:36:55.644615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-499333534-project Jun 29 11:36:55.644615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:36:55.644615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:55.644615 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': '2d4d9da5-e4b3-407e-9b1d-4a33a8829015'} Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:36:55.645543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. Jun 29 11:36:55.647025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:55.648367 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d551045c-05f0-4d01-9713-b04dd7ec10c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Returning 404 to user: Instance 2d4d9da5-e4b3-407e-9b1d-4a33a8829015 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:36:55.648367 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d551045c-05f0-4d01-9713-b04dd7ec10c1 tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015" status: 404 len: 111 microversion: 2.20 time: 0.030157 Jun 29 11:36:55.648367 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 505/1014] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:36:55 2022] GET /compute/v2.1/servers/2d4d9da5-e4b3-407e-9b1d-4a33a8829015 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 11:36:56.983949 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4e1eaa7e-6f7c-4d7b-871f-b8d6e4311daa tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:56.984445 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4e1eaa7e-6f7c-4d7b-871f-b8d6e4311daa tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:56.991368 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e1eaa7e-6f7c-4d7b-871f-b8d6e4311daa tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:56.991822 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e1eaa7e-6f7c-4d7b-871f-b8d6e4311daa tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:56.992596 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e1eaa7e-6f7c-4d7b-871f-b8d6e4311daa tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:56.993034 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e1eaa7e-6f7c-4d7b-871f-b8d6e4311daa tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:57.006267 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-4e1eaa7e-6f7c-4d7b-871f-b8d6e4311daa tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] HTTP exception thrown: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4e1eaa7e-6f7c-4d7b-871f-b8d6e4311daa tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Request method failure captured: Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 HTTP/1.1 Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDcJtqXZgTA5bnAtNLAViYu8KzbirrJvshhtBHvnHgq6za50BpQcslYYakTA3-uP91chtsP_XKm95_9nU3EV4CLN90PURAN-_0uEJKrmAX-2ThVGQOPDhdZZpK7YmkmmJBpGCjcuu1WY2HT6WVGtUjp6Sc_xl8eXENID5Ioj39zHAnU Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 364a7eaf772c434e9e38a18430425895 Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:36:57.008525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:36:57.009985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/364a7eaf772c434e9e38a18430425895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_364a7eaf772c434e9e38a18430425895", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/364a7eaf772c434e9e38a18430425895"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/364a7eaf772c434e9e38a18430425895"}]}] Jun 29 11:36:57.009985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:57.009985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 364a7eaf772c434e9e38a18430425895 Jun 29 11:36:57.009985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:57.009985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-499333534-project Jun 29 11:36:57.009985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:36:57.009985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:36:57.009985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: 275df17696084dce9e7af487275bacab Jun 29 11:36:57.009985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-499333534-project Jun 29 11:36:57.009985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:36:57.009985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:36:57.009985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': 'bde34fdf-bfe6-48a4-9b9e-95ff879ffa70'} Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:36:57.010741 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:36:57.012338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:36:57.014109 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4e1eaa7e-6f7c-4d7b-871f-b8d6e4311daa tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Returning 404 to user: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:36:57.014109 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4e1eaa7e-6f7c-4d7b-871f-b8d6e4311daa tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 404 len: 111 microversion: 2.20 time: 0.030071 Jun 29 11:36:57.014109 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 510/1015] 10.222.0.44 () {60 vars in 1279 bytes} [Wed Jun 29 11:36:56 2022] DELETE /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 11:36:57.018161 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6951b370-8fbb-47ac-b22c-2be10ea8c3ac tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:36:57.018760 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6951b370-8fbb-47ac-b22c-2be10ea8c3ac tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] [instance: bde34fdf-bfe6-48a4-9b9e-95ff879ffa70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:36:57.025137 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6951b370-8fbb-47ac-b22c-2be10ea8c3ac tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:57.025582 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6951b370-8fbb-47ac-b22c-2be10ea8c3ac tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:57.026332 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6951b370-8fbb-47ac-b22c-2be10ea8c3ac tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:36:57.026767 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6951b370-8fbb-47ac-b22c-2be10ea8c3ac tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:36:57.039570 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-6951b370-8fbb-47ac-b22c-2be10ea8c3ac tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] HTTP exception thrown: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6951b370-8fbb-47ac-b22c-2be10ea8c3ac tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Request method failure captured: Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 HTTP/1.1 Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDcJtqXZgTA5bnAtNLAViYu8KzbirrJvshhtBHvnHgq6za50BpQcslYYakTA3-uP91chtsP_XKm95_9nU3EV4CLN90PURAN-_0uEJKrmAX-2ThVGQOPDhdZZpK7YmkmmJBpGCjcuu1WY2HT6WVGtUjp6Sc_xl8eXENID5Ioj39zHAnU Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 364a7eaf772c434e9e38a18430425895 Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:36:57.041109 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:36:57.042737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/364a7eaf772c434e9e38a18430425895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_364a7eaf772c434e9e38a18430425895", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/364a7eaf772c434e9e38a18430425895"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/364a7eaf772c434e9e38a18430425895"}]}] Jun 29 11:36:57.042737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:57.042737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 364a7eaf772c434e9e38a18430425895 Jun 29 11:36:57.042737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-499333534 Jun 29 11:36:57.042737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeShelveTestJSON-499333534-project Jun 29 11:36:57.042737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:36:57.042737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:36:57.042737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 275df17696084dce9e7af487275bacab Jun 29 11:36:57.042737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-499333534-project Jun 29 11:36:57.042737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:36:57.042737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:36:57.042737 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': 'bde34fdf-bfe6-48a4-9b9e-95ff879ffa70'} Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:36:57.043912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. Jun 29 11:36:57.045366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:36:57.046929 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6951b370-8fbb-47ac-b22c-2be10ea8c3ac tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] Returning 404 to user: Instance bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:36:57.046929 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6951b370-8fbb-47ac-b22c-2be10ea8c3ac tempest-AttachVolumeShelveTestJSON-499333534 tempest-AttachVolumeShelveTestJSON-499333534-project] 10.222.0.44 "GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70" status: 404 len: 111 microversion: 2.20 time: 0.028167 Jun 29 11:36:57.046929 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 506/1016] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jun 29 11:36:57 2022] GET /compute/v2.1/servers/bde34fdf-bfe6-48a4-9b9e-95ff879ffa70 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 29 11:37:08.962872 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-713ad24e-f13b-47ea-b989-d7823e14fe37 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:08.963382 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-713ad24e-f13b-47ea-b989-d7823e14fe37 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:08.963475 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-82be34d6-4d6c-4d22-a1d8-763dfc86486a req-ccd779da-5ca0-412f-8c29-d1a659a7f6fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a258c3-e36f-4542-bef5-586c66bb0e15", "tag": "880f98df-d8a5-4578-a7a6-a37e254c889d"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:37:08.969069 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=15 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:37:08.969069 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:37:08.969678 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:37:08.969678 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=24 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:37:08.973374 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-713ad24e-f13b-47ea-b989-d7823e14fe37 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:08.973826 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-713ad24e-f13b-47ea-b989-d7823e14fe37 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:08.974649 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-713ad24e-f13b-47ea-b989-d7823e14fe37 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:08.975108 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-713ad24e-f13b-47ea-b989-d7823e14fe37 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:08.984040 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-82be34d6-4d6c-4d22-a1d8-763dfc86486a req-ccd779da-5ca0-412f-8c29-d1a659a7f6fc service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:08.984495 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-82be34d6-4d6c-4d22-a1d8-763dfc86486a req-ccd779da-5ca0-412f-8c29-d1a659a7f6fc service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:09.004511 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-82be34d6-4d6c-4d22-a1d8-763dfc86486a req-ccd779da-5ca0-412f-8c29-d1a659a7f6fc service nova] Creating event network-changed:880f98df-d8a5-4578-a7a6-a37e254c889d for instance 98a258c3-e36f-4542-bef5-586c66bb0e15 on hv-cinder-84733 Jun 29 11:37:09.010439 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-713ad24e-f13b-47ea-b989-d7823e14fe37 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:37:09.021545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-82be34d6-4d6c-4d22-a1d8-763dfc86486a req-ccd779da-5ca0-412f-8c29-d1a659a7f6fc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062187 Jun 29 11:37:09.022154 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 507/1017] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:37:09.297103 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-713ad24e-f13b-47ea-b989-d7823e14fe37 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "DELETE /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 204 len: 0 microversion: 2.1 time: 0.339618 Jun 29 11:37:09.300124 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 511/1018] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:37:08 2022] DELETE /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:37:09.311781 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ec90cb6c-3f36-4ef2-905a-093e738dac50 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:09.312748 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ec90cb6c-3f36-4ef2-905a-093e738dac50 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:09.321642 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec90cb6c-3f36-4ef2-905a-093e738dac50 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:09.322097 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec90cb6c-3f36-4ef2-905a-093e738dac50 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:09.322874 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec90cb6c-3f36-4ef2-905a-093e738dac50 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:09.323494 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec90cb6c-3f36-4ef2-905a-093e738dac50 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:09.470120 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ec90cb6c-3f36-4ef2-905a-093e738dac50 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:37:09.478151 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ec90cb6c-3f36-4ef2-905a-093e738dac50 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1575 microversion: 2.1 time: 0.173396 Jun 29 11:37:09.478836 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 508/1019] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:37:09 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:37:10.498513 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-694ab0f1-d79b-4662-a332-047994477bbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:10.499336 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-694ab0f1-d79b-4662-a332-047994477bbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:10.509116 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-694ab0f1-d79b-4662-a332-047994477bbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:10.510111 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-694ab0f1-d79b-4662-a332-047994477bbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:10.511047 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-694ab0f1-d79b-4662-a332-047994477bbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:10.511677 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-694ab0f1-d79b-4662-a332-047994477bbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:10.708584 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-694ab0f1-d79b-4662-a332-047994477bbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:37:10.717285 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-694ab0f1-d79b-4662-a332-047994477bbc tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1575 microversion: 2.1 time: 0.223825 Jun 29 11:37:10.717864 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 512/1020] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:37:10 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:37:11.734693 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cf828df6-42b2-4f83-898e-e4ace37bdaec tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:11.740233 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cf828df6-42b2-4f83-898e-e4ace37bdaec tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:11.741768 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cf828df6-42b2-4f83-898e-e4ace37bdaec tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:11.742207 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cf828df6-42b2-4f83-898e-e4ace37bdaec tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:11.742959 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cf828df6-42b2-4f83-898e-e4ace37bdaec tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:11.743391 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cf828df6-42b2-4f83-898e-e4ace37bdaec tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:11.826290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cf828df6-42b2-4f83-898e-e4ace37bdaec tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:37:11.835169 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cf828df6-42b2-4f83-898e-e4ace37bdaec tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1390 microversion: 2.1 time: 0.104451 Jun 29 11:37:11.836632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 509/1021] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:37:11 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1390 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:37:11.838332 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-215f8b67-42f6-4a7b-b8e3-f26ebc850b7f req-735cec82-5764-47dc-90c9-9f5c7a302e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a258c3-e36f-4542-bef5-586c66bb0e15", "name": "network-vif-deleted", "tag": "880f98df-d8a5-4578-a7a6-a37e254c889d"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:37:11.847227 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-215f8b67-42f6-4a7b-b8e3-f26ebc850b7f req-735cec82-5764-47dc-90c9-9f5c7a302e00 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:11.847676 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-215f8b67-42f6-4a7b-b8e3-f26ebc850b7f req-735cec82-5764-47dc-90c9-9f5c7a302e00 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:11.860997 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-215f8b67-42f6-4a7b-b8e3-f26ebc850b7f req-735cec82-5764-47dc-90c9-9f5c7a302e00 service nova] Creating event network-vif-deleted:880f98df-d8a5-4578-a7a6-a37e254c889d for instance 98a258c3-e36f-4542-bef5-586c66bb0e15 on hv-cinder-84733 Jun 29 11:37:11.865827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-215f8b67-42f6-4a7b-b8e3-f26ebc850b7f req-735cec82-5764-47dc-90c9-9f5c7a302e00 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032001 Jun 29 11:37:11.866429 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 513/1022] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:37:12.855040 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-131bfafc-62fc-4be1-812b-579f6a6ac50a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:12.855606 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-131bfafc-62fc-4be1-812b-579f6a6ac50a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:12.862305 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-131bfafc-62fc-4be1-812b-579f6a6ac50a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:12.865004 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-131bfafc-62fc-4be1-812b-579f6a6ac50a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:12.865004 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-131bfafc-62fc-4be1-812b-579f6a6ac50a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:12.865004 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-131bfafc-62fc-4be1-812b-579f6a6ac50a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:12.893269 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-131bfafc-62fc-4be1-812b-579f6a6ac50a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:12.893710 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-131bfafc-62fc-4be1-812b-579f6a6ac50a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:12.894149 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-131bfafc-62fc-4be1-812b-579f6a6ac50a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lazy-loading 'fault' on Instance uuid 98a258c3-e36f-4542-bef5-586c66bb0e15 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:37:12.935648 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-131bfafc-62fc-4be1-812b-579f6a6ac50a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:37:12.943175 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-131bfafc-62fc-4be1-812b-579f6a6ac50a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 200 len: 1230 microversion: 2.1 time: 0.092717 Jun 29 11:37:12.943730 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 510/1023] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:37:12 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:37:13.961056 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ecf47367-11bc-4eeb-bc89-15f93f667b58 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:13.963012 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ecf47367-11bc-4eeb-bc89-15f93f667b58 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 98a258c3-e36f-4542-bef5-586c66bb0e15] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:13.967949 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecf47367-11bc-4eeb-bc89-15f93f667b58 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:13.968393 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecf47367-11bc-4eeb-bc89-15f93f667b58 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:13.969143 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecf47367-11bc-4eeb-bc89-15f93f667b58 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:13.969574 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ecf47367-11bc-4eeb-bc89-15f93f667b58 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:13.983112 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-ecf47367-11bc-4eeb-bc89-15f93f667b58 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] HTTP exception thrown: Instance 98a258c3-e36f-4542-bef5-586c66bb0e15 could not be found. Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ecf47367-11bc-4eeb-bc89-15f93f667b58 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Request method failure captured: Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 HTTP/1.1 Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDczywj0HT1KRfuqpM0zP2C-D8VWM0B9Cr_89zQLJwK_Y2CyTZ4V0G0tlk01Xy1o58iLJnv7CwMzJlOapUbyuh6zZDVPCmgix0rRtMV6_g27ltkHqUycI8UEfLBLFnhnMnP7olJV9yWa_FVD01xdlqfIGl4jLQCAEr0vFCiTmMW0P0w Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: cdc0456bfa5a4619a96b41d3437fd82c Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:37:13.985017 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:37:13.986647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cdc0456bfa5a4619a96b41d3437fd82c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cdc0456bfa5a4619a96b41d3437fd82c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cdc0456bfa5a4619a96b41d3437fd82c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cdc0456bfa5a4619a96b41d3437fd82c"}]}] Jun 29 11:37:13.986647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:37:13.986647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: cdc0456bfa5a4619a96b41d3437fd82c Jun 29 11:37:13.986647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:37:13.986647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-1359380287-project Jun 29 11:37:13.986647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:37:13.986647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:37:13.986647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: e91cc0b93f484f759233469ec5f37bb4 Jun 29 11:37:13.986647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-1359380287-project Jun 29 11:37:13.986647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:37:13.986647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 98a258c3-e36f-4542-bef5-586c66bb0e15 could not be found. Jun 29 11:37:13.986647 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '98a258c3-e36f-4542-bef5-586c66bb0e15'} Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a258c3-e36f-4542-bef5-586c66bb0e15 could not be found. Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:37:13.987575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a258c3-e36f-4542-bef5-586c66bb0e15 could not be found. Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a258c3-e36f-4542-bef5-586c66bb0e15 could not be found. Jun 29 11:37:13.989176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:13.990722 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ecf47367-11bc-4eeb-bc89-15f93f667b58 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Returning 404 to user: Instance 98a258c3-e36f-4542-bef5-586c66bb0e15 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:37:13.990722 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ecf47367-11bc-4eeb-bc89-15f93f667b58 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15" status: 404 len: 111 microversion: 2.1 time: 0.030015 Jun 29 11:37:13.990722 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 514/1024] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:37:13 2022] GET /compute/v2.1/servers/98a258c3-e36f-4542-bef5-586c66bb0e15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:37:17.363950 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a0cb4a44-d128-4b13-9e9e-b8ce5ef3aa68 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:17.364640 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a0cb4a44-d128-4b13-9e9e-b8ce5ef3aa68 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:17.368146 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-8a683cb0-87f6-4bea-bf35-eb96dac3c7fd req-54175827-8427-4d49-bcf6-d68de839f88f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00bf9bd8-c879-4105-8185-5390ce9d61aa", "tag": "b4466d29-fb33-463a-8b05-3045971a9d75"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:37:17.372022 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a0cb4a44-d128-4b13-9e9e-b8ce5ef3aa68 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:17.372649 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a0cb4a44-d128-4b13-9e9e-b8ce5ef3aa68 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:17.373591 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a0cb4a44-d128-4b13-9e9e-b8ce5ef3aa68 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:17.374173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a0cb4a44-d128-4b13-9e9e-b8ce5ef3aa68 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:17.377940 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8a683cb0-87f6-4bea-bf35-eb96dac3c7fd req-54175827-8427-4d49-bcf6-d68de839f88f service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:17.379303 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8a683cb0-87f6-4bea-bf35-eb96dac3c7fd req-54175827-8427-4d49-bcf6-d68de839f88f service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:17.391886 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-8a683cb0-87f6-4bea-bf35-eb96dac3c7fd req-54175827-8427-4d49-bcf6-d68de839f88f service nova] Creating event network-changed:b4466d29-fb33-463a-8b05-3045971a9d75 for instance 00bf9bd8-c879-4105-8185-5390ce9d61aa on hv-cinder-84733 Jun 29 11:37:17.401571 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-8a683cb0-87f6-4bea-bf35-eb96dac3c7fd req-54175827-8427-4d49-bcf6-d68de839f88f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037263 Jun 29 11:37:17.402530 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 515/1025] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:37:17.404827 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a0cb4a44-d128-4b13-9e9e-b8ce5ef3aa68 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:37:17.725797 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a0cb4a44-d128-4b13-9e9e-b8ce5ef3aa68 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "DELETE /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 204 len: 0 microversion: 2.1 time: 0.366054 Jun 29 11:37:17.726641 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 511/1026] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:37:17 2022] DELETE /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:37:17.736075 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-43895bc3-27aa-4ad5-aa47-e967e6d33c9c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:17.742492 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-43895bc3-27aa-4ad5-aa47-e967e6d33c9c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:17.749715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43895bc3-27aa-4ad5-aa47-e967e6d33c9c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:17.750484 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43895bc3-27aa-4ad5-aa47-e967e6d33c9c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:17.751270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43895bc3-27aa-4ad5-aa47-e967e6d33c9c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:17.754672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43895bc3-27aa-4ad5-aa47-e967e6d33c9c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:17.902132 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-43895bc3-27aa-4ad5-aa47-e967e6d33c9c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:37:17.909826 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-43895bc3-27aa-4ad5-aa47-e967e6d33c9c tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1577 microversion: 2.1 time: 0.178575 Jun 29 11:37:17.910376 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 516/1027] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:37:17 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:37:18.927539 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-23ff2a68-ed39-49eb-a045-a7536eb253d3 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:18.928288 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-23ff2a68-ed39-49eb-a045-a7536eb253d3 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:18.934763 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23ff2a68-ed39-49eb-a045-a7536eb253d3 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:18.935200 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23ff2a68-ed39-49eb-a045-a7536eb253d3 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:18.935978 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23ff2a68-ed39-49eb-a045-a7536eb253d3 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:18.940976 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23ff2a68-ed39-49eb-a045-a7536eb253d3 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:19.140040 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-23ff2a68-ed39-49eb-a045-a7536eb253d3 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:37:19.147576 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-23ff2a68-ed39-49eb-a045-a7536eb253d3 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1458 microversion: 2.1 time: 0.224299 Jun 29 11:37:19.151153 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 512/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:37:18 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1458 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:37:19.571657 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-a1155729-6ad1-4f66-b13b-7e056ac791bc req-ce6edbb1-19de-481d-a570-ff0b535158f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00bf9bd8-c879-4105-8185-5390ce9d61aa", "name": "network-vif-deleted", "tag": "b4466d29-fb33-463a-8b05-3045971a9d75"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:37:19.580043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a1155729-6ad1-4f66-b13b-7e056ac791bc req-ce6edbb1-19de-481d-a570-ff0b535158f8 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:19.586766 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a1155729-6ad1-4f66-b13b-7e056ac791bc req-ce6edbb1-19de-481d-a570-ff0b535158f8 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:19.591125 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-a1155729-6ad1-4f66-b13b-7e056ac791bc req-ce6edbb1-19de-481d-a570-ff0b535158f8 service nova] Creating event network-vif-deleted:b4466d29-fb33-463a-8b05-3045971a9d75 for instance 00bf9bd8-c879-4105-8185-5390ce9d61aa on hv-cinder-84733 Jun 29 11:37:19.596161 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-a1155729-6ad1-4f66-b13b-7e056ac791bc req-ce6edbb1-19de-481d-a570-ff0b535158f8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028633 Jun 29 11:37:19.597934 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 517/1029] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:37:20.166203 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7f3dfa3f-3a46-4800-b90d-6e03cb2d231a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:20.166818 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7f3dfa3f-3a46-4800-b90d-6e03cb2d231a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:20.173371 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f3dfa3f-3a46-4800-b90d-6e03cb2d231a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:20.173815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f3dfa3f-3a46-4800-b90d-6e03cb2d231a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:20.174580 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f3dfa3f-3a46-4800-b90d-6e03cb2d231a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:20.175025 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f3dfa3f-3a46-4800-b90d-6e03cb2d231a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:20.243576 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7f3dfa3f-3a46-4800-b90d-6e03cb2d231a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91cc0b93f484f759233469ec5f37bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc0456bfa5a4619a96b41d3437fd82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:37:20.251300 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7f3dfa3f-3a46-4800-b90d-6e03cb2d231a tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 200 len: 1226 microversion: 2.1 time: 0.089761 Jun 29 11:37:20.251994 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 513/1030] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:37:20 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:37:21.272055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13a183cc-5adf-409f-a8a7-c93d28d39de2 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:21.272055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-13a183cc-5adf-409f-a8a7-c93d28d39de2 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 00bf9bd8-c879-4105-8185-5390ce9d61aa] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:21.276648 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13a183cc-5adf-409f-a8a7-c93d28d39de2 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:21.277109 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13a183cc-5adf-409f-a8a7-c93d28d39de2 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:21.277878 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13a183cc-5adf-409f-a8a7-c93d28d39de2 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:21.278316 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13a183cc-5adf-409f-a8a7-c93d28d39de2 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:21.292178 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-13a183cc-5adf-409f-a8a7-c93d28d39de2 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] HTTP exception thrown: Instance 00bf9bd8-c879-4105-8185-5390ce9d61aa could not be found. Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13a183cc-5adf-409f-a8a7-c93d28d39de2 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Request method failure captured: Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa HTTP/1.1 Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDczywj0HT1KRfuqpM0zP2C-D8VWM0B9Cr_89zQLJwK_Y2CyTZ4V0G0tlk01Xy1o58iLJnv7CwMzJlOapUbyuh6zZDVPCmgix0rRtMV6_g27ltkHqUycI8UEfLBLFnhnMnP7olJV9yWa_FVD01xdlqfIGl4jLQCAEr0vFCiTmMW0P0w Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: cdc0456bfa5a4619a96b41d3437fd82c Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:37:21.293827 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:37:21.295531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cdc0456bfa5a4619a96b41d3437fd82c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cdc0456bfa5a4619a96b41d3437fd82c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cdc0456bfa5a4619a96b41d3437fd82c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cdc0456bfa5a4619a96b41d3437fd82c"}]}] Jun 29 11:37:21.295531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:37:21.295531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: cdc0456bfa5a4619a96b41d3437fd82c Jun 29 11:37:21.295531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:37:21.295531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-1359380287-project Jun 29 11:37:21.295531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:37:21.295531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:37:21.295531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: e91cc0b93f484f759233469ec5f37bb4 Jun 29 11:37:21.295531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-1359380287-project Jun 29 11:37:21.295531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:37:21.295531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 00bf9bd8-c879-4105-8185-5390ce9d61aa could not be found. Jun 29 11:37:21.295531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '00bf9bd8-c879-4105-8185-5390ce9d61aa'} Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00bf9bd8-c879-4105-8185-5390ce9d61aa could not be found. Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:37:21.298278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00bf9bd8-c879-4105-8185-5390ce9d61aa could not be found. Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00bf9bd8-c879-4105-8185-5390ce9d61aa could not be found. Jun 29 11:37:21.299996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.301363 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13a183cc-5adf-409f-a8a7-c93d28d39de2 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Returning 404 to user: Instance 00bf9bd8-c879-4105-8185-5390ce9d61aa could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:37:21.301363 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-13a183cc-5adf-409f-a8a7-c93d28d39de2 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa" status: 404 len: 111 microversion: 2.1 time: 0.030503 Jun 29 11:37:21.301363 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 518/1031] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:37:21 2022] GET /compute/v2.1/servers/00bf9bd8-c879-4105-8185-5390ce9d61aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:37:21.862748 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b235876d-7071-441b-9bed-72511d3736f8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:21.863230 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b235876d-7071-441b-9bed-72511d3736f8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:21.869418 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b235876d-7071-441b-9bed-72511d3736f8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:21.873379 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b235876d-7071-441b-9bed-72511d3736f8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:21.879592 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b235876d-7071-441b-9bed-72511d3736f8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:21.879592 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b235876d-7071-441b-9bed-72511d3736f8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:21.891725 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-b235876d-7071-441b-9bed-72511d3736f8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] HTTP exception thrown: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b235876d-7071-441b-9bed-72511d3736f8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Request method failure captured: Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e HTTP/1.1 Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDczywj0HT1KRfuqpM0zP2C-D8VWM0B9Cr_89zQLJwK_Y2CyTZ4V0G0tlk01Xy1o58iLJnv7CwMzJlOapUbyuh6zZDVPCmgix0rRtMV6_g27ltkHqUycI8UEfLBLFnhnMnP7olJV9yWa_FVD01xdlqfIGl4jLQCAEr0vFCiTmMW0P0w Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: cdc0456bfa5a4619a96b41d3437fd82c Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:37:21.893545 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:37:21.895152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cdc0456bfa5a4619a96b41d3437fd82c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cdc0456bfa5a4619a96b41d3437fd82c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cdc0456bfa5a4619a96b41d3437fd82c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cdc0456bfa5a4619a96b41d3437fd82c"}]}] Jun 29 11:37:21.895152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:37:21.895152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: cdc0456bfa5a4619a96b41d3437fd82c Jun 29 11:37:21.895152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:37:21.895152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-TestVolumeBootPattern-1359380287-project Jun 29 11:37:21.895152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:37:21.895152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:37:21.895152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: e91cc0b93f484f759233469ec5f37bb4 Jun 29 11:37:21.895152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-TestVolumeBootPattern-1359380287-project Jun 29 11:37:21.895152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:37:21.895152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:37:21.895152 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': '44d99b83-36d5-48e9-9557-95e6f29f9f7e'} Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:37:21.899691 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:37:21.901362 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.902889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b235876d-7071-441b-9bed-72511d3736f8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Returning 404 to user: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:37:21.902889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b235876d-7071-441b-9bed-72511d3736f8 tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "DELETE /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 404 len: 111 microversion: 2.1 time: 0.037111 Jun 29 11:37:21.902889 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 514/1032] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:37:21 2022] DELETE /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:37:21.905885 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-679941d2-e8e2-44ef-8f83-6c8bb6929e2f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:21.906501 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-679941d2-e8e2-44ef-8f83-6c8bb6929e2f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] [instance: 44d99b83-36d5-48e9-9557-95e6f29f9f7e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:37:21.916397 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-679941d2-e8e2-44ef-8f83-6c8bb6929e2f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:21.916841 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-679941d2-e8e2-44ef-8f83-6c8bb6929e2f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:21.917663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-679941d2-e8e2-44ef-8f83-6c8bb6929e2f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:37:21.918262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-679941d2-e8e2-44ef-8f83-6c8bb6929e2f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:37:21.931919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-679941d2-e8e2-44ef-8f83-6c8bb6929e2f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] HTTP exception thrown: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-679941d2-e8e2-44ef-8f83-6c8bb6929e2f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Request method failure captured: Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e HTTP/1.1 Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDczywj0HT1KRfuqpM0zP2C-D8VWM0B9Cr_89zQLJwK_Y2CyTZ4V0G0tlk01Xy1o58iLJnv7CwMzJlOapUbyuh6zZDVPCmgix0rRtMV6_g27ltkHqUycI8UEfLBLFnhnMnP7olJV9yWa_FVD01xdlqfIGl4jLQCAEr0vFCiTmMW0P0w Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: cdc0456bfa5a4619a96b41d3437fd82c Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:37:21.933522 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:37:21.935113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cdc0456bfa5a4619a96b41d3437fd82c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cdc0456bfa5a4619a96b41d3437fd82c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cdc0456bfa5a4619a96b41d3437fd82c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cdc0456bfa5a4619a96b41d3437fd82c"}]}] Jun 29 11:37:21.935113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:37:21.935113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: cdc0456bfa5a4619a96b41d3437fd82c Jun 29 11:37:21.935113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-1359380287 Jun 29 11:37:21.935113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-1359380287-project Jun 29 11:37:21.935113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:37:21.935113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:37:21.935113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: e91cc0b93f484f759233469ec5f37bb4 Jun 29 11:37:21.935113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-1359380287-project Jun 29 11:37:21.935113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:37:21.935113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:37:21.935113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '44d99b83-36d5-48e9-9557-95e6f29f9f7e'} Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:37:21.936214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. Jun 29 11:37:21.937701 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:37:21.939093 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-679941d2-e8e2-44ef-8f83-6c8bb6929e2f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Returning 404 to user: Instance 44d99b83-36d5-48e9-9557-95e6f29f9f7e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:37:21.939093 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-679941d2-e8e2-44ef-8f83-6c8bb6929e2f tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e" status: 404 len: 111 microversion: 2.1 time: 0.032733 Jun 29 11:37:21.939093 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 519/1033] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:37:21 2022] GET /compute/v2.1/servers/44d99b83-36d5-48e9-9557-95e6f29f9f7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:37:23.517160 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7712cdad-bd17-429b-afb7-0de2b95071cd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] Calling method '.version_select at 0x7fd089530670>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:37:23.600614 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7712cdad-bd17-429b-afb7-0de2b95071cd tempest-TestVolumeBootPattern-1359380287 tempest-TestVolumeBootPattern-1359380287-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2084883613" status: 202 len: 0 microversion: 2.1 time: 0.091465 Jun 29 11:37:23.601211 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 515/1034] 10.222.0.44 () {58 vars in 1262 bytes} [Wed Jun 29 11:37:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2084883613 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 11:38:19.797644 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:19.798379 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:19.982632 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e23b1e76-8f4c-48cb-acb1-616a93bfe9c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:19.983630 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e23b1e76-8f4c-48cb-acb1-616a93bfe9c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:19.990130 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23b1e76-8f4c-48cb-acb1-616a93bfe9c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:19.990577 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23b1e76-8f4c-48cb-acb1-616a93bfe9c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:19.991325 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23b1e76-8f4c-48cb-acb1-616a93bfe9c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:19.991754 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e23b1e76-8f4c-48cb-acb1-616a93bfe9c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:20.014710 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e23b1e76-8f4c-48cb-acb1-616a93bfe9c1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/ips" status: 200 len: 150 microversion: 2.1 time: 0.222962 Jun 29 11:38:20.015321 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 520/1035] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jun 29 11:38:19 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/ips => generated 150 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:38:21.592679 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:21.594034 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:21.598333 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-814b3eb2-2acb-42eb-848a-ba9f1a74f201 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70a3650f-c6ae-4f20-bc0d-eb63df3a4368"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:38:21.599499 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-814b3eb2-2acb-42eb-848a-ba9f1a74f201 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:21.606211 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-814b3eb2-2acb-42eb-848a-ba9f1a74f201 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:21.610450 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-814b3eb2-2acb-42eb-848a-ba9f1a74f201 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:21.610450 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-814b3eb2-2acb-42eb-848a-ba9f1a74f201 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:21.610450 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-814b3eb2-2acb-42eb-848a-ba9f1a74f201 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:22.390527 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-814b3eb2-2acb-42eb-848a-ba9f1a74f201 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798948 Jun 29 11:38:22.394530 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 516/1036] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:38:21 2022] POST /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:38:26.464480 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1982550160", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "networks": [{"uuid": "85d5219a-f67d-4d9b-bb48-f18ed7d85833"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:38:26.516415 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] validate_networks() for [('85d5219a-f67d-4d9b-bb48-f18ed7d85833', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:38:26.913879 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:38:26.914309 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:38:26.914786 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:38:26.915207 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:38:26.915771 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:38:26.925274 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:26.925754 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:26.926548 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:26.926991 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:26.944844 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Getting quotas for project db642fb7d52f4fdfa95cd85555c79af3. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:38:26.948756 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Getting quotas for user 8c0159323d8d46ffb28b8071fcf0acf2 and project db642fb7d52f4fdfa95cd85555c79af3. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:38:26.959398 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:38:26.961696 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:38:27.058620 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e0a245a9-7dc4-4119-9e9a-ed86e2b5d42a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598178 Jun 29 11:38:27.059268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 521/1037] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:38:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:38:27.070803 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-11ab4158-d609-45d4-899f-ae49eb2221d0 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:27.071496 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-11ab4158-d609-45d4-899f-ae49eb2221d0 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:27.123629 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-11ab4158-d609-45d4-899f-ae49eb2221d0 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:27.130819 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-11ab4158-d609-45d4-899f-ae49eb2221d0 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1219 microversion: 2.1 time: 0.064660 Jun 29 11:38:27.131374 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 517/1038] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:27 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:28.148153 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0188ddee-016f-4d00-9242-9ac840c455c4 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:28.148676 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0188ddee-016f-4d00-9242-9ac840c455c4 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:28.155452 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0188ddee-016f-4d00-9242-9ac840c455c4 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:28.155932 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0188ddee-016f-4d00-9242-9ac840c455c4 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:28.160260 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0188ddee-016f-4d00-9242-9ac840c455c4 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:28.160260 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0188ddee-016f-4d00-9242-9ac840c455c4 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:28.220345 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0188ddee-016f-4d00-9242-9ac840c455c4 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:28.227859 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0188ddee-016f-4d00-9242-9ac840c455c4 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1223 microversion: 2.1 time: 0.083712 Jun 29 11:38:28.228415 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 522/1039] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:28 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:29.245035 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c6e5aa10-7d16-4618-9091-f72a664339f6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:29.245634 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c6e5aa10-7d16-4618-9091-f72a664339f6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:29.253558 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6e5aa10-7d16-4618-9091-f72a664339f6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:29.253995 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6e5aa10-7d16-4618-9091-f72a664339f6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:29.254823 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6e5aa10-7d16-4618-9091-f72a664339f6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:29.255253 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6e5aa10-7d16-4618-9091-f72a664339f6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:29.316630 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c6e5aa10-7d16-4618-9091-f72a664339f6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:29.324239 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c6e5aa10-7d16-4618-9091-f72a664339f6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1271 microversion: 2.1 time: 0.083054 Jun 29 11:38:29.324915 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 518/1040] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:29 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:30.341737 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-caac6dff-ca23-4b5b-8f25-62c43472a1fd tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:30.342450 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-caac6dff-ca23-4b5b-8f25-62c43472a1fd tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:30.351104 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-caac6dff-ca23-4b5b-8f25-62c43472a1fd tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:30.351613 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-caac6dff-ca23-4b5b-8f25-62c43472a1fd tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:30.352493 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-caac6dff-ca23-4b5b-8f25-62c43472a1fd tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:30.353019 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-caac6dff-ca23-4b5b-8f25-62c43472a1fd tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:30.512684 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-caac6dff-ca23-4b5b-8f25-62c43472a1fd tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:30.520838 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-caac6dff-ca23-4b5b-8f25-62c43472a1fd tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1319 microversion: 2.1 time: 0.183117 Jun 29 11:38:30.521442 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 523/1041] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:30 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:30.939631 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1d0737d7-1938-4dec-b59c-ad8a618f97dc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70a3650f-c6ae-4f20-bc0d-eb63df3a4368"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:38:30.940797 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1d0737d7-1938-4dec-b59c-ad8a618f97dc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:30.947290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d0737d7-1938-4dec-b59c-ad8a618f97dc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:30.947814 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d0737d7-1938-4dec-b59c-ad8a618f97dc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:30.948611 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d0737d7-1938-4dec-b59c-ad8a618f97dc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:30.949049 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d0737d7-1938-4dec-b59c-ad8a618f97dc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:31.045834 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-1d0737d7-1938-4dec-b59c-ad8a618f97dc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Invalid volume: volume 70a3650f-c6ae-4f20-bc0d-eb63df3a4368 is already attached to instances: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1d0737d7-1938-4dec-b59c-ad8a618f97dc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: POST /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments HTTP/1.1 Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 74 Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:38:31.047584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:38:31.049315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:38:31.049315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:38:31.049315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:38:31.049315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:38:31.049315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:38:31.049315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:38:31.049315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:38:31.049315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:38:31.049315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:38:31.049315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Jun 29 11:38:31.049315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {"volumeAttachment": {"volumeId": "70a3650f-c6ae-4f20-bc0d-eb63df3a4368"}} Jun 29 11:38:31.049315 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Invalid volume: volume 70a3650f-c6ae-4f20-bc0d-eb63df3a4368 is already attached to instances: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'server_id': '69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2', 'body': {'volumeAttachment': {'volumeId': '70a3650f-c6ae-4f20-bc0d-eb63df3a4368'}}} Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 70a3650f-c6ae-4f20-bc0d-eb63df3a4368 is already attached to instances: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:38:31.050171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 70a3650f-c6ae-4f20-bc0d-eb63df3a4368 is already attached to instances: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:38:31.051609 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:38:31.060394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:38:31.060394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:38:31.060394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:38:31.060394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 70a3650f-c6ae-4f20-bc0d-eb63df3a4368 is already attached to instances: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 Jun 29 11:38:31.060394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:38:31.060394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1d0737d7-1938-4dec-b59c-ad8a618f97dc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 400 to user: Invalid volume: volume 70a3650f-c6ae-4f20-bc0d-eb63df3a4368 is already attached to instances: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:38:31.060394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1d0737d7-1938-4dec-b59c-ad8a618f97dc tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114034 Jun 29 11:38:31.060394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 519/1042] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:38:30 2022] POST /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 11:38:31.120690 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b6556a37-8f85-40df-9895-5adedb985067 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:31.121275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b6556a37-8f85-40df-9895-5adedb985067 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:31.127686 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6556a37-8f85-40df-9895-5adedb985067 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:31.128160 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6556a37-8f85-40df-9895-5adedb985067 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:31.128920 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6556a37-8f85-40df-9895-5adedb985067 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:31.129349 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6556a37-8f85-40df-9895-5adedb985067 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:31.211048 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-b6556a37-8f85-40df-9895-5adedb985067 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lazy-loading 'services' on Instance uuid 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:38:31.395015 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-c62571c8-c3ad-4222-8ec4-6d488a934afe req-ca8625c6-7dc9-4f9b-9acd-caa9d9257623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd3907c4-f492-4501-80c7-d3d982a40af3", "tag": "9670b961-99d0-4d99-8df0-60eee9644e31"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:38:31.402984 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c62571c8-c3ad-4222-8ec4-6d488a934afe req-ca8625c6-7dc9-4f9b-9acd-caa9d9257623 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:31.403426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c62571c8-c3ad-4222-8ec4-6d488a934afe req-ca8625c6-7dc9-4f9b-9acd-caa9d9257623 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:31.415548 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-c62571c8-c3ad-4222-8ec4-6d488a934afe req-ca8625c6-7dc9-4f9b-9acd-caa9d9257623 service nova] Creating event network-changed:9670b961-99d0-4d99-8df0-60eee9644e31 for instance fd3907c4-f492-4501-80c7-d3d982a40af3 on hv-cinder-84733 Jun 29 11:38:31.420140 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-c62571c8-c3ad-4222-8ec4-6d488a934afe req-ca8625c6-7dc9-4f9b-9acd-caa9d9257623 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029312 Jun 29 11:38:31.420720 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 520/1043] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:38:31.455763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b6556a37-8f85-40df-9895-5adedb985067 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments/70a3650f-c6ae-4f20-bc0d-eb63df3a4368" status: 202 len: 0 microversion: 2.1 time: 0.338818 Jun 29 11:38:31.456530 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 524/1044] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jun 29 11:38:31 2022] DELETE /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments/70a3650f-c6ae-4f20-bc0d-eb63df3a4368 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:38:31.466377 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-827f0198-cd81-4aea-9dea-4af845ec936b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:31.467974 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-827f0198-cd81-4aea-9dea-4af845ec936b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:31.475064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-827f0198-cd81-4aea-9dea-4af845ec936b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:31.475647 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-827f0198-cd81-4aea-9dea-4af845ec936b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:31.476439 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-827f0198-cd81-4aea-9dea-4af845ec936b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:31.476869 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-827f0198-cd81-4aea-9dea-4af845ec936b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:31.506293 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-827f0198-cd81-4aea-9dea-4af845ec936b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Jun 29 11:38:31.506850 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 521/1045] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:38:31 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:38:31.543283 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-89ecb1cc-d5e2-45cb-8123-82d626637041 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:31.544058 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-89ecb1cc-d5e2-45cb-8123-82d626637041 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:31.551527 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89ecb1cc-d5e2-45cb-8123-82d626637041 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:31.552184 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89ecb1cc-d5e2-45cb-8123-82d626637041 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:31.552952 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89ecb1cc-d5e2-45cb-8123-82d626637041 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:31.553411 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89ecb1cc-d5e2-45cb-8123-82d626637041 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:31.710116 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-89ecb1cc-d5e2-45cb-8123-82d626637041 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:31.717452 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-89ecb1cc-d5e2-45cb-8123-82d626637041 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1319 microversion: 2.1 time: 0.178544 Jun 29 11:38:31.718004 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 525/1046] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:31 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:32.518531 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-54a2c484-fc2c-4f03-a16f-8fa5f65ebe56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:32.519497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-54a2c484-fc2c-4f03-a16f-8fa5f65ebe56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:32.526061 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-54a2c484-fc2c-4f03-a16f-8fa5f65ebe56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:32.526500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-54a2c484-fc2c-4f03-a16f-8fa5f65ebe56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:32.527286 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-54a2c484-fc2c-4f03-a16f-8fa5f65ebe56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:32.527717 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-54a2c484-fc2c-4f03-a16f-8fa5f65ebe56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:32.557687 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-54a2c484-fc2c-4f03-a16f-8fa5f65ebe56 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 Jun 29 11:38:32.558274 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 522/1047] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:38:32 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:38:32.733418 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-afae203a-1c7e-417a-a66b-def9f8a9ac9c tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:32.734037 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-afae203a-1c7e-417a-a66b-def9f8a9ac9c tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:32.741341 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afae203a-1c7e-417a-a66b-def9f8a9ac9c tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:32.741941 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afae203a-1c7e-417a-a66b-def9f8a9ac9c tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:32.742708 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afae203a-1c7e-417a-a66b-def9f8a9ac9c tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:32.743143 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-afae203a-1c7e-417a-a66b-def9f8a9ac9c tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:32.875750 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-afae203a-1c7e-417a-a66b-def9f8a9ac9c tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:32.883178 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-afae203a-1c7e-417a-a66b-def9f8a9ac9c tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1319 microversion: 2.1 time: 0.153723 Jun 29 11:38:32.883733 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 526/1048] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:32 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:33.569967 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b30ff716-ee3b-45f4-8acf-d2283a9cace2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:33.570869 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b30ff716-ee3b-45f4-8acf-d2283a9cace2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:33.577281 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b30ff716-ee3b-45f4-8acf-d2283a9cace2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:33.577722 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b30ff716-ee3b-45f4-8acf-d2283a9cace2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:33.578463 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b30ff716-ee3b-45f4-8acf-d2283a9cace2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:33.578932 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b30ff716-ee3b-45f4-8acf-d2283a9cace2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:33.607112 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b30ff716-ee3b-45f4-8acf-d2283a9cace2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041068 Jun 29 11:38:33.607673 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 523/1049] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:38:33 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 11:38:33.662883 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f689b492-837e-4a47-99bd-3a85dc79512b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:33.663413 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f689b492-837e-4a47-99bd-3a85dc79512b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:33.669396 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f689b492-837e-4a47-99bd-3a85dc79512b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:33.669841 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f689b492-837e-4a47-99bd-3a85dc79512b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:33.670595 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f689b492-837e-4a47-99bd-3a85dc79512b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:33.671057 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f689b492-837e-4a47-99bd-3a85dc79512b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:33.695516 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f689b492-837e-4a47-99bd-3a85dc79512b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:38:33.900442 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3db268a1-1436-4599-9167-c4ce63459346 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:33.900966 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3db268a1-1436-4599-9167-c4ce63459346 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:33.907354 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3db268a1-1436-4599-9167-c4ce63459346 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:33.911574 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3db268a1-1436-4599-9167-c4ce63459346 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:33.911574 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3db268a1-1436-4599-9167-c4ce63459346 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:33.911574 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3db268a1-1436-4599-9167-c4ce63459346 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:33.941202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f689b492-837e-4a47-99bd-3a85dc79512b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 204 len: 0 microversion: 2.1 time: 0.281847 Jun 29 11:38:33.941802 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 527/1050] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:38:33 2022] DELETE /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:38:33.950057 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f33c8afe-67f9-47ff-8bb7-e0dec5033c1d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:33.950754 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f33c8afe-67f9-47ff-8bb7-e0dec5033c1d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:33.956909 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f33c8afe-67f9-47ff-8bb7-e0dec5033c1d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:33.957575 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f33c8afe-67f9-47ff-8bb7-e0dec5033c1d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:33.958101 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f33c8afe-67f9-47ff-8bb7-e0dec5033c1d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:33.958531 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f33c8afe-67f9-47ff-8bb7-e0dec5033c1d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:34.089202 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3db268a1-1436-4599-9167-c4ce63459346 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:34.097061 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3db268a1-1436-4599-9167-c4ce63459346 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1319 microversion: 2.1 time: 0.200793 Jun 29 11:38:34.097624 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 524/1051] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:33 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:38:34.119193 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f33c8afe-67f9-47ff-8bb7-e0dec5033c1d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:34.126595 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f33c8afe-67f9-47ff-8bb7-e0dec5033c1d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1683 microversion: 2.1 time: 0.180575 Jun 29 11:38:34.127275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 528/1052] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:33 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:38:35.113215 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3deee95a-0970-4b0b-8938-a994b7cef1d6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:35.113809 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3deee95a-0970-4b0b-8938-a994b7cef1d6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:35.120346 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3deee95a-0970-4b0b-8938-a994b7cef1d6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:35.120781 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3deee95a-0970-4b0b-8938-a994b7cef1d6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:35.121522 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3deee95a-0970-4b0b-8938-a994b7cef1d6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:35.121946 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3deee95a-0970-4b0b-8938-a994b7cef1d6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:35.143682 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-396d75ad-6112-42c6-b609-417ab0910504 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:35.144339 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-396d75ad-6112-42c6-b609-417ab0910504 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:35.150870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-396d75ad-6112-42c6-b609-417ab0910504 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:35.151324 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-396d75ad-6112-42c6-b609-417ab0910504 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:35.152112 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-396d75ad-6112-42c6-b609-417ab0910504 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:35.152556 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-396d75ad-6112-42c6-b609-417ab0910504 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:35.316118 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3deee95a-0970-4b0b-8938-a994b7cef1d6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:35.322717 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-396d75ad-6112-42c6-b609-417ab0910504 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:35.323594 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3deee95a-0970-4b0b-8938-a994b7cef1d6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1319 microversion: 2.1 time: 0.214456 Jun 29 11:38:35.324203 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 525/1053] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:35 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:35.330632 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-396d75ad-6112-42c6-b609-417ab0910504 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1683 microversion: 2.1 time: 0.191334 Jun 29 11:38:35.331185 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 529/1054] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:35 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:38:36.340719 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6f5a5fca-6906-497b-993f-fa069f162529 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:36.341348 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6f5a5fca-6906-497b-993f-fa069f162529 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:36.348568 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f5a5fca-6906-497b-993f-fa069f162529 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:36.349015 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f5a5fca-6906-497b-993f-fa069f162529 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:36.349172 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d9a9727-a493-4d46-b354-12d055c3d00c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:36.349779 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f5a5fca-6906-497b-993f-fa069f162529 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:36.349911 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0d9a9727-a493-4d46-b354-12d055c3d00c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:36.350210 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f5a5fca-6906-497b-993f-fa069f162529 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:36.356307 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d9a9727-a493-4d46-b354-12d055c3d00c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:36.356752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d9a9727-a493-4d46-b354-12d055c3d00c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:36.357500 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d9a9727-a493-4d46-b354-12d055c3d00c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:36.357928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d9a9727-a493-4d46-b354-12d055c3d00c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:36.545862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6f5a5fca-6906-497b-993f-fa069f162529 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:36.554380 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6f5a5fca-6906-497b-993f-fa069f162529 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1319 microversion: 2.1 time: 0.217443 Jun 29 11:38:36.554891 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 526/1055] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:36 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:36.558134 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0d9a9727-a493-4d46-b354-12d055c3d00c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:36.565941 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0d9a9727-a493-4d46-b354-12d055c3d00c tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1683 microversion: 2.1 time: 0.221913 Jun 29 11:38:36.566673 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 530/1056] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:36 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1683 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:37.552332 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-b3f6accc-fb21-48b2-9f9a-18f275d55e2d req-9170db1d-d124-45c2-ac22-36c7cca56d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2", "name": "network-vif-deleted", "tag": "4430f461-9cb7-4ecb-a22c-a47394a7322a"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:38:37.555703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:37.563497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-b3f6accc-fb21-48b2-9f9a-18f275d55e2d req-9170db1d-d124-45c2-ac22-36c7cca56d9b service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:37.563961 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-b3f6accc-fb21-48b2-9f9a-18f275d55e2d req-9170db1d-d124-45c2-ac22-36c7cca56d9b service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:37.572540 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-918dd4fd-3ff2-4105-9010-66107036c600 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:37.573143 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-918dd4fd-3ff2-4105-9010-66107036c600 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:37.575786 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-b3f6accc-fb21-48b2-9f9a-18f275d55e2d req-9170db1d-d124-45c2-ac22-36c7cca56d9b service nova] Creating event network-vif-deleted:4430f461-9cb7-4ecb-a22c-a47394a7322a for instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 on hv-cinder-84733 Jun 29 11:38:37.579434 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:37.580162 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:37.582464 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-b3f6accc-fb21-48b2-9f9a-18f275d55e2d req-9170db1d-d124-45c2-ac22-36c7cca56d9b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033693 Jun 29 11:38:37.582681 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-918dd4fd-3ff2-4105-9010-66107036c600 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:37.583051 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 527/1057] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:38:37.583939 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-918dd4fd-3ff2-4105-9010-66107036c600 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:37.585475 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-918dd4fd-3ff2-4105-9010-66107036c600 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:37.586179 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-918dd4fd-3ff2-4105-9010-66107036c600 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:37.590406 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a052b4a8-80a6-4c8c-8c79-90552a32455b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:37.591280 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a052b4a8-80a6-4c8c-8c79-90552a32455b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:37.599170 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a052b4a8-80a6-4c8c-8c79-90552a32455b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:37.599170 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a052b4a8-80a6-4c8c-8c79-90552a32455b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:37.599580 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a052b4a8-80a6-4c8c-8c79-90552a32455b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:37.600069 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a052b4a8-80a6-4c8c-8c79-90552a32455b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:37.684091 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a052b4a8-80a6-4c8c-8c79-90552a32455b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:37.696330 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a052b4a8-80a6-4c8c-8c79-90552a32455b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 200 len: 1615 microversion: 2.1 time: 0.111318 Jun 29 11:38:37.699909 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 528/1058] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:37 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 1615 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:37.792219 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-918dd4fd-3ff2-4105-9010-66107036c600 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:37.802752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-918dd4fd-3ff2-4105-9010-66107036c600 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1319 microversion: 2.1 time: 0.235002 Jun 29 11:38:37.803353 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 531/1059] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:37 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:38.598581 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-adcfb6e0-8157-4113-9859-00832716e9cc req-30f40acd-f243-49cd-b013-344464f5d680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3907c4-f492-4501-80c7-d3d982a40af3", "name": "network-vif-plugged", "status": "completed", "tag": "9670b961-99d0-4d99-8df0-60eee9644e31"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:38:38.608188 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-adcfb6e0-8157-4113-9859-00832716e9cc req-30f40acd-f243-49cd-b013-344464f5d680 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:38.608635 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-adcfb6e0-8157-4113-9859-00832716e9cc req-30f40acd-f243-49cd-b013-344464f5d680 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:38.620791 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-adcfb6e0-8157-4113-9859-00832716e9cc req-30f40acd-f243-49cd-b013-344464f5d680 service nova] Creating event network-vif-plugged:9670b961-99d0-4d99-8df0-60eee9644e31 for instance fd3907c4-f492-4501-80c7-d3d982a40af3 on hv-cinder-84733 Jun 29 11:38:38.625794 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-adcfb6e0-8157-4113-9859-00832716e9cc req-30f40acd-f243-49cd-b013-344464f5d680 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030832 Jun 29 11:38:38.626742 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 529/1060] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:38:38.714097 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3a95951b-ae55-4886-939a-fd35d2c4c3f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:38.717900 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3a95951b-ae55-4886-939a-fd35d2c4c3f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:38.722195 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a95951b-ae55-4886-939a-fd35d2c4c3f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:38.722651 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a95951b-ae55-4886-939a-fd35d2c4c3f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:38.723420 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a95951b-ae55-4886-939a-fd35d2c4c3f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:38.723938 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a95951b-ae55-4886-939a-fd35d2c4c3f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:38.738265 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-3a95951b-ae55-4886-939a-fd35d2c4c3f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3a95951b-ae55-4886-939a-fd35d2c4c3f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 HTTP/1.1 Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:38:38.740202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:38:38.741877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:38:38.741877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:38:38.741877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:38:38.741877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:38:38.741877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:38:38.741877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:38:38.741877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:38:38.741877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:38:38.741877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:38:38.741877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:38:38.741877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:38:38.741877 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2'} Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:38:38.742809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:38:38.746930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:38:38.748404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3a95951b-ae55-4886-939a-fd35d2c4c3f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 404 to user: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:38:38.748404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3a95951b-ae55-4886-939a-fd35d2c4c3f2 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 404 len: 111 microversion: 2.1 time: 0.031566 Jun 29 11:38:38.748404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 532/1061] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:38 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:38:38.750951 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0f11b6a9-05e0-492b-8b46-fb2b0619810a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '.version_select at 0x7fd089549e50>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:38.823937 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-872e958d-ea84-4cf6-935f-2636aadbc878 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:38.824580 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-872e958d-ea84-4cf6-935f-2636aadbc878 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:38.831102 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-872e958d-ea84-4cf6-935f-2636aadbc878 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:38.831550 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-872e958d-ea84-4cf6-935f-2636aadbc878 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:38.832351 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-872e958d-ea84-4cf6-935f-2636aadbc878 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:38.832775 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-872e958d-ea84-4cf6-935f-2636aadbc878 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:38.856621 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0f11b6a9-05e0-492b-8b46-fb2b0619810a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844120252" status: 202 len: 0 microversion: 2.1 time: 0.109815 Jun 29 11:38:38.857233 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 530/1062] 10.222.0.44 () {58 vars in 1220 bytes} [Wed Jun 29 11:38:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844120252 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:38:39.073602 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-872e958d-ea84-4cf6-935f-2636aadbc878 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:39.081638 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-872e958d-ea84-4cf6-935f-2636aadbc878 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1319 microversion: 2.1 time: 0.261592 Jun 29 11:38:39.082215 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 533/1063] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:38 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:39.731716 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-91987f05-8ed9-480f-9387-2f9c904abf54 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: .version_select at 0x7fd0894de8b0>, body: {"keypair": {"name": "tempest-keypair-1719128933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB83dbu/3+xb3NgmFnR4UwN1URwvqrxfyBimhaPzAn6fxe4TLsEnhtU786WPgl2r1934B69Gd3lDs+2nSc0j0fHE/cmBug5qI/JP3MbhvgnmeH2mnQhKrD3Spr1Ig5BQbg=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:38:39.746797 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-91987f05-8ed9-480f-9387-2f9c904abf54 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:38:39.750780 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-91987f05-8ed9-480f-9387-2f9c904abf54 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for user cf7bc4681c954c158a7051046bd9aa47 and project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:38:39.839270 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-91987f05-8ed9-480f-9387-2f9c904abf54 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111928 Jun 29 11:38:39.839869 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 531/1064] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jun 29 11:38:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:38:40.097674 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6b52f719-ae92-47b2-b2d1-93c3c46f7073 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:40.098294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6b52f719-ae92-47b2-b2d1-93c3c46f7073 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:40.104789 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b52f719-ae92-47b2-b2d1-93c3c46f7073 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:40.105237 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b52f719-ae92-47b2-b2d1-93c3c46f7073 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:40.106005 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b52f719-ae92-47b2-b2d1-93c3c46f7073 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:40.106445 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6b52f719-ae92-47b2-b2d1-93c3c46f7073 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:40.235403 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6b52f719-ae92-47b2-b2d1-93c3c46f7073 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:40.242938 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6b52f719-ae92-47b2-b2d1-93c3c46f7073 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1319 microversion: 2.1 time: 0.149115 Jun 29 11:38:40.243516 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 534/1065] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:40 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:41.260251 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-957b9b2f-082e-4844-b85c-31e933d8ac43 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:41.261001 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-957b9b2f-082e-4844-b85c-31e933d8ac43 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:41.267203 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-957b9b2f-082e-4844-b85c-31e933d8ac43 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:41.267639 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-957b9b2f-082e-4844-b85c-31e933d8ac43 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:41.268491 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-957b9b2f-082e-4844-b85c-31e933d8ac43 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:41.268921 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-957b9b2f-082e-4844-b85c-31e933d8ac43 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:41.403047 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-957b9b2f-082e-4844-b85c-31e933d8ac43 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:41.411045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-957b9b2f-082e-4844-b85c-31e933d8ac43 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1507 microversion: 2.1 time: 0.155159 Jun 29 11:38:41.411618 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 532/1066] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:41 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:42.094087 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-537002634", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42f5ddc9-93c3-4cb7-9c4a-2481dc4d5579"}], "security_groups": [{"name": "tempest-securitygroup--253084577"}], "key_name": "tempest-keypair-1719128933", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:38:42.197100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] validate_networks() for [('42f5ddc9-93c3-4cb7-9c4a-2481dc4d5579', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:38:42.567550 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:38:42.568095 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:38:42.568587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:38:42.568993 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:38:42.569399 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:38:42.579426 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:42.580041 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:42.580895 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:42.581329 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:42.598838 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:38:42.602699 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Getting quotas for user cf7bc4681c954c158a7051046bd9aa47 and project 7e39c9a1ff3c46dcbe4464f57534e5ea. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:38:42.614001 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:38:42.616442 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:38:42.788462 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fba8278c-8e02-40c9-a398-86a08faaea5e tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.698789 Jun 29 11:38:42.789113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 535/1067] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:38:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:38:42.799073 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-26db2a19-dce2-4d18-bb3f-c9c0a0fa1f4b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:42.799683 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-26db2a19-dce2-4d18-bb3f-c9c0a0fa1f4b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:42.857354 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-26db2a19-dce2-4d18-bb3f-c9c0a0fa1f4b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:42.865561 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-26db2a19-dce2-4d18-bb3f-c9c0a0fa1f4b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1241 microversion: 2.1 time: 0.070407 Jun 29 11:38:42.866155 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 533/1068] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:42 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:43.883922 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-37e39297-104b-4aa8-a90d-ff05c2b0c449 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:43.884947 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-37e39297-104b-4aa8-a90d-ff05c2b0c449 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:43.891718 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37e39297-104b-4aa8-a90d-ff05c2b0c449 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:43.892214 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37e39297-104b-4aa8-a90d-ff05c2b0c449 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:43.893040 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37e39297-104b-4aa8-a90d-ff05c2b0c449 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:43.893472 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37e39297-104b-4aa8-a90d-ff05c2b0c449 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:43.916091 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:43.960335 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-37e39297-104b-4aa8-a90d-ff05c2b0c449 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:43.967885 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-37e39297-104b-4aa8-a90d-ff05c2b0c449 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1245 microversion: 2.1 time: 0.088403 Jun 29 11:38:43.968339 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 536/1069] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:43 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:44.984162 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-09097559-8932-4fce-a256-bed6742d3d24 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:44.985061 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-09097559-8932-4fce-a256-bed6742d3d24 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:44.994592 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09097559-8932-4fce-a256-bed6742d3d24 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:44.995041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09097559-8932-4fce-a256-bed6742d3d24 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:44.995796 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09097559-8932-4fce-a256-bed6742d3d24 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:44.996258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09097559-8932-4fce-a256-bed6742d3d24 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:45.059503 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-09097559-8932-4fce-a256-bed6742d3d24 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:45.070046 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-09097559-8932-4fce-a256-bed6742d3d24 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1293 microversion: 2.1 time: 0.087498 Jun 29 11:38:45.070046 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 534/1070] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:44 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:46.085852 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3fc84d9a-0ead-4012-a208-940d364491fe tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:46.086461 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3fc84d9a-0ead-4012-a208-940d364491fe tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:46.093616 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fc84d9a-0ead-4012-a208-940d364491fe tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:46.094137 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fc84d9a-0ead-4012-a208-940d364491fe tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:46.094983 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fc84d9a-0ead-4012-a208-940d364491fe tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:46.096054 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fc84d9a-0ead-4012-a208-940d364491fe tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:46.322806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3fc84d9a-0ead-4012-a208-940d364491fe tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:46.330856 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3fc84d9a-0ead-4012-a208-940d364491fe tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1366 microversion: 2.1 time: 0.249316 Jun 29 11:38:46.331415 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 537/1071] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:46 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:47.022927 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-76695c1b-c490-4fec-93b9-c8610b0d3fbb req-20150e77-7c04-4fe1-9da6-b88f34c511b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a3566a4-3530-4d09-b0f4-954ed471e75b", "tag": "3ec8214a-e957-4cb6-afc7-e5122f68d64e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:38:47.039386 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-76695c1b-c490-4fec-93b9-c8610b0d3fbb req-20150e77-7c04-4fe1-9da6-b88f34c511b2 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:47.039858 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-76695c1b-c490-4fec-93b9-c8610b0d3fbb req-20150e77-7c04-4fe1-9da6-b88f34c511b2 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:47.052012 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-76695c1b-c490-4fec-93b9-c8610b0d3fbb req-20150e77-7c04-4fe1-9da6-b88f34c511b2 service nova] Creating event network-changed:3ec8214a-e957-4cb6-afc7-e5122f68d64e for instance 5a3566a4-3530-4d09-b0f4-954ed471e75b on hv-cinder-84733 Jun 29 11:38:47.057440 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-76695c1b-c490-4fec-93b9-c8610b0d3fbb req-20150e77-7c04-4fe1-9da6-b88f34c511b2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046105 Jun 29 11:38:47.058381 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 535/1072] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:38:47.348596 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d8bc9ccf-826b-4fb4-8fd2-ce85b814b4c9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:47.349326 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d8bc9ccf-826b-4fb4-8fd2-ce85b814b4c9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:47.356151 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8bc9ccf-826b-4fb4-8fd2-ce85b814b4c9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:47.356607 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8bc9ccf-826b-4fb4-8fd2-ce85b814b4c9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:47.357378 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8bc9ccf-826b-4fb4-8fd2-ce85b814b4c9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:47.357818 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d8bc9ccf-826b-4fb4-8fd2-ce85b814b4c9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:47.526733 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d8bc9ccf-826b-4fb4-8fd2-ce85b814b4c9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:47.534825 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d8bc9ccf-826b-4fb4-8fd2-ce85b814b4c9 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1366 microversion: 2.1 time: 0.190805 Jun 29 11:38:47.535484 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 538/1073] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:47 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:38:48.552245 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-443b2675-47c6-4d9f-941c-3b44b7736ea8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:48.552929 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-443b2675-47c6-4d9f-941c-3b44b7736ea8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:48.559492 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-443b2675-47c6-4d9f-941c-3b44b7736ea8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:48.559959 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-443b2675-47c6-4d9f-941c-3b44b7736ea8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:48.560765 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-443b2675-47c6-4d9f-941c-3b44b7736ea8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:48.561274 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-443b2675-47c6-4d9f-941c-3b44b7736ea8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:48.696173 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-443b2675-47c6-4d9f-941c-3b44b7736ea8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:48.703558 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-443b2675-47c6-4d9f-941c-3b44b7736ea8 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1366 microversion: 2.1 time: 0.155756 Jun 29 11:38:48.704150 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 536/1074] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:48 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:49.721395 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f38667af-7b07-40f4-a51c-22d3b3750bc4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:49.722042 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f38667af-7b07-40f4-a51c-22d3b3750bc4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:49.728734 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f38667af-7b07-40f4-a51c-22d3b3750bc4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:49.729181 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f38667af-7b07-40f4-a51c-22d3b3750bc4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:49.729938 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f38667af-7b07-40f4-a51c-22d3b3750bc4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:49.730373 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f38667af-7b07-40f4-a51c-22d3b3750bc4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:49.861357 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f38667af-7b07-40f4-a51c-22d3b3750bc4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:49.869734 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f38667af-7b07-40f4-a51c-22d3b3750bc4 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1366 microversion: 2.1 time: 0.152757 Jun 29 11:38:49.870309 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 539/1075] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:49 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:50.886723 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5555b050-9ec3-400c-a27d-ce08e6866b9d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:50.887343 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5555b050-9ec3-400c-a27d-ce08e6866b9d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:50.893975 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5555b050-9ec3-400c-a27d-ce08e6866b9d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:50.898026 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5555b050-9ec3-400c-a27d-ce08e6866b9d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:50.898026 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5555b050-9ec3-400c-a27d-ce08e6866b9d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:50.898026 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5555b050-9ec3-400c-a27d-ce08e6866b9d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:51.121117 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5555b050-9ec3-400c-a27d-ce08e6866b9d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:51.124773 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:51.129082 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5555b050-9ec3-400c-a27d-ce08e6866b9d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1366 microversion: 2.1 time: 0.246474 Jun 29 11:38:51.129665 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 537/1076] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:50 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:52.146551 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-911923ad-c1d6-431f-8354-4250a8384251 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:52.147095 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-911923ad-c1d6-431f-8354-4250a8384251 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:52.149443 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:52.154228 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-911923ad-c1d6-431f-8354-4250a8384251 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:52.154676 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-911923ad-c1d6-431f-8354-4250a8384251 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:52.155446 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-911923ad-c1d6-431f-8354-4250a8384251 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:52.155922 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-911923ad-c1d6-431f-8354-4250a8384251 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:52.283023 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-911923ad-c1d6-431f-8354-4250a8384251 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:52.290410 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-911923ad-c1d6-431f-8354-4250a8384251 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1366 microversion: 2.1 time: 0.148445 Jun 29 11:38:52.290975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 540/1077] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:52 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:52.698499 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-abfc3b35-9c16-49df-a2dc-d9893db9e12b req-3e3a0f90-f302-428d-9b4d-49b7d26423ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3566a4-3530-4d09-b0f4-954ed471e75b", "name": "network-vif-plugged", "status": "completed", "tag": "3ec8214a-e957-4cb6-afc7-e5122f68d64e"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:38:52.703497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:52.708051 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-abfc3b35-9c16-49df-a2dc-d9893db9e12b req-3e3a0f90-f302-428d-9b4d-49b7d26423ab service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:52.708487 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-abfc3b35-9c16-49df-a2dc-d9893db9e12b req-3e3a0f90-f302-428d-9b4d-49b7d26423ab service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:52.719026 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-abfc3b35-9c16-49df-a2dc-d9893db9e12b req-3e3a0f90-f302-428d-9b4d-49b7d26423ab service nova] Creating event network-vif-plugged:3ec8214a-e957-4cb6-afc7-e5122f68d64e for instance 5a3566a4-3530-4d09-b0f4-954ed471e75b on hv-cinder-84733 Jun 29 11:38:52.724605 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-abfc3b35-9c16-49df-a2dc-d9893db9e12b req-3e3a0f90-f302-428d-9b4d-49b7d26423ab service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029624 Jun 29 11:38:52.725177 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 538/1078] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:38:53.308071 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-deeb0bfa-2159-4e75-ac2c-63b8ccbeb2bd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:53.308598 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-deeb0bfa-2159-4e75-ac2c-63b8ccbeb2bd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:53.310943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:53.311598 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:53.316896 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-deeb0bfa-2159-4e75-ac2c-63b8ccbeb2bd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:53.317342 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-deeb0bfa-2159-4e75-ac2c-63b8ccbeb2bd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:53.318644 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-deeb0bfa-2159-4e75-ac2c-63b8ccbeb2bd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:53.318644 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-deeb0bfa-2159-4e75-ac2c-63b8ccbeb2bd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:53.445462 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-deeb0bfa-2159-4e75-ac2c-63b8ccbeb2bd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:53.452770 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-deeb0bfa-2159-4e75-ac2c-63b8ccbeb2bd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1366 microversion: 2.1 time: 0.148708 Jun 29 11:38:53.453327 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 541/1079] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:53 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:54.471002 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9d432cea-8bf3-48bb-8899-333c77af808b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:54.471700 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9d432cea-8bf3-48bb-8899-333c77af808b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:54.474248 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:38:54.480804 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9d432cea-8bf3-48bb-8899-333c77af808b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:54.488694 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9d432cea-8bf3-48bb-8899-333c77af808b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:54.488694 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9d432cea-8bf3-48bb-8899-333c77af808b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:54.488694 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9d432cea-8bf3-48bb-8899-333c77af808b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:54.613733 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9d432cea-8bf3-48bb-8899-333c77af808b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:54.621031 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9d432cea-8bf3-48bb-8899-333c77af808b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1366 microversion: 2.1 time: 0.154963 Jun 29 11:38:54.621576 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 539/1080] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:54 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:55.638506 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fc41d452-d12d-4ff8-8f63-686a3ad7d76d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:55.639136 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fc41d452-d12d-4ff8-8f63-686a3ad7d76d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:55.645576 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc41d452-d12d-4ff8-8f63-686a3ad7d76d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:55.646594 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc41d452-d12d-4ff8-8f63-686a3ad7d76d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:55.647339 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc41d452-d12d-4ff8-8f63-686a3ad7d76d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:55.647766 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc41d452-d12d-4ff8-8f63-686a3ad7d76d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:55.774716 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc41d452-d12d-4ff8-8f63-686a3ad7d76d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:38:55.782183 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fc41d452-d12d-4ff8-8f63-686a3ad7d76d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1557 microversion: 2.1 time: 0.147538 Jun 29 11:38:55.782738 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 542/1081] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:38:55 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:38:55.798839 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3884cd47-0395-4f10-bc7c-38efea366453 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:38:55.799366 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3884cd47-0395-4f10-bc7c-38efea366453 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:38:55.806540 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3884cd47-0395-4f10-bc7c-38efea366453 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:55.806994 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3884cd47-0395-4f10-bc7c-38efea366453 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:55.807756 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3884cd47-0395-4f10-bc7c-38efea366453 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:55.808220 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3884cd47-0395-4f10-bc7c-38efea366453 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:55.888480 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3884cd47-0395-4f10-bc7c-38efea366453 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093505 Jun 29 11:38:55.889132 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 540/1082] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jun 29 11:38:55 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:38:56.900075 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-a3bb8e29-03b9-4e7b-b06e-7703e8cf8349 req-61d29201-8ccd-4384-bdf6-2d9081b81eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a3566a4-3530-4d09-b0f4-954ed471e75b", "tag": "3ec8214a-e957-4cb6-afc7-e5122f68d64e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:38:56.908746 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a3bb8e29-03b9-4e7b-b06e-7703e8cf8349 req-61d29201-8ccd-4384-bdf6-2d9081b81eff service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:38:56.909189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a3bb8e29-03b9-4e7b-b06e-7703e8cf8349 req-61d29201-8ccd-4384-bdf6-2d9081b81eff service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:38:56.920492 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-a3bb8e29-03b9-4e7b-b06e-7703e8cf8349 req-61d29201-8ccd-4384-bdf6-2d9081b81eff service nova] Creating event network-changed:3ec8214a-e957-4cb6-afc7-e5122f68d64e for instance 5a3566a4-3530-4d09-b0f4-954ed471e75b on hv-cinder-84733 Jun 29 11:38:56.925606 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-a3bb8e29-03b9-4e7b-b06e-7703e8cf8349 req-61d29201-8ccd-4384-bdf6-2d9081b81eff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031238 Jun 29 11:38:56.926232 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 543/1083] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:39:03.198235 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b8c4a061-49e2-4899-8d73-715b0b1f3282 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "436082cd-544e-4fe8-b16c-7e5322344f10", "device": "/dev/sdb"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:39:03.199806 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b8c4a061-49e2-4899-8d73-715b0b1f3282 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:03.205770 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b8c4a061-49e2-4899-8d73-715b0b1f3282 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:03.206211 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b8c4a061-49e2-4899-8d73-715b0b1f3282 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:03.206956 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b8c4a061-49e2-4899-8d73-715b0b1f3282 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:03.207385 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b8c4a061-49e2-4899-8d73-715b0b1f3282 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:03.927045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b8c4a061-49e2-4899-8d73-715b0b1f3282 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "POST /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733108 Jun 29 11:39:03.927640 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 541/1084] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:39:03 2022] POST /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:39:31.454759 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=7 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:39:31.455497 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=40 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:39:31.459623 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6bdf79bb-3f60-4f65-87c3-4fad35df4d5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:31.460229 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6bdf79bb-3f60-4f65-87c3-4fad35df4d5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:31.467787 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdf79bb-3f60-4f65-87c3-4fad35df4d5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:31.468268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdf79bb-3f60-4f65-87c3-4fad35df4d5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:31.469031 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdf79bb-3f60-4f65-87c3-4fad35df4d5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:31.469495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bdf79bb-3f60-4f65-87c3-4fad35df4d5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:31.550633 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-6bdf79bb-3f60-4f65-87c3-4fad35df4d5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lazy-loading 'services' on Instance uuid fd3907c4-f492-4501-80c7-d3d982a40af3 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:39:31.780716 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6bdf79bb-3f60-4f65-87c3-4fad35df4d5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3/os-volume_attachments/436082cd-544e-4fe8-b16c-7e5322344f10" status: 202 len: 0 microversion: 2.1 time: 0.327156 Jun 29 11:39:31.781354 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 544/1085] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jun 29 11:39:31 2022] DELETE /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3/os-volume_attachments/436082cd-544e-4fe8-b16c-7e5322344f10 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:39:32.898751 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dd7549dc-6a9a-4229-b292-a59b6355d304 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:32.899330 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dd7549dc-6a9a-4229-b292-a59b6355d304 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:32.902573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=7 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:39:32.903279 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:39:32.908235 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd7549dc-6a9a-4229-b292-a59b6355d304 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:32.908683 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd7549dc-6a9a-4229-b292-a59b6355d304 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:32.909480 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd7549dc-6a9a-4229-b292-a59b6355d304 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:32.909877 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd7549dc-6a9a-4229-b292-a59b6355d304 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:32.935867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dd7549dc-6a9a-4229-b292-a59b6355d304 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:39:33.306251 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dd7549dc-6a9a-4229-b292-a59b6355d304 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 204 len: 0 microversion: 2.1 time: 0.410880 Jun 29 11:39:33.306785 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 542/1086] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:39:32 2022] DELETE /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:39:33.315954 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-22168e9d-eb1a-49b6-a613-9b376eaa8aae tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:33.316688 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-22168e9d-eb1a-49b6-a613-9b376eaa8aae tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:33.323472 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22168e9d-eb1a-49b6-a613-9b376eaa8aae tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:33.323957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22168e9d-eb1a-49b6-a613-9b376eaa8aae tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:33.324719 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22168e9d-eb1a-49b6-a613-9b376eaa8aae tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:33.325159 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22168e9d-eb1a-49b6-a613-9b376eaa8aae tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:33.464775 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-22168e9d-eb1a-49b6-a613-9b376eaa8aae tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:33.472148 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-22168e9d-eb1a-49b6-a613-9b376eaa8aae tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1513 microversion: 2.1 time: 0.160877 Jun 29 11:39:33.472715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 545/1087] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:33 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:39:34.490157 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a62156af-f0b1-4608-95e4-366569cf473a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:34.490855 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a62156af-f0b1-4608-95e4-366569cf473a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:34.498498 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a62156af-f0b1-4608-95e4-366569cf473a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:34.498959 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a62156af-f0b1-4608-95e4-366569cf473a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:34.499705 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a62156af-f0b1-4608-95e4-366569cf473a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:34.500174 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a62156af-f0b1-4608-95e4-366569cf473a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:34.630053 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a62156af-f0b1-4608-95e4-366569cf473a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:34.638098 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a62156af-f0b1-4608-95e4-366569cf473a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1513 microversion: 2.1 time: 0.152428 Jun 29 11:39:34.638666 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 543/1088] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:34 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:39:35.655048 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6c475e0e-8267-4e95-91fe-2c90c0ab102a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:35.656013 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6c475e0e-8267-4e95-91fe-2c90c0ab102a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:35.662565 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c475e0e-8267-4e95-91fe-2c90c0ab102a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:35.663019 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c475e0e-8267-4e95-91fe-2c90c0ab102a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:35.663784 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c475e0e-8267-4e95-91fe-2c90c0ab102a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:35.664236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c475e0e-8267-4e95-91fe-2c90c0ab102a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:35.846189 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6c475e0e-8267-4e95-91fe-2c90c0ab102a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:35.854457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6c475e0e-8267-4e95-91fe-2c90c0ab102a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1513 microversion: 2.1 time: 0.203211 Jun 29 11:39:35.855476 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 546/1089] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:35 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:39:36.108292 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-929ad45c-e943-48d8-95d8-bba63bca39f7 req-cc0478e6-8447-486d-9994-3ec580967944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3907c4-f492-4501-80c7-d3d982a40af3", "name": "network-vif-deleted", "tag": "9670b961-99d0-4d99-8df0-60eee9644e31"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:39:36.117129 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-929ad45c-e943-48d8-95d8-bba63bca39f7 req-cc0478e6-8447-486d-9994-3ec580967944 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:36.117570 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-929ad45c-e943-48d8-95d8-bba63bca39f7 req-cc0478e6-8447-486d-9994-3ec580967944 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:36.128140 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-929ad45c-e943-48d8-95d8-bba63bca39f7 req-cc0478e6-8447-486d-9994-3ec580967944 service nova] Creating event network-vif-deleted:9670b961-99d0-4d99-8df0-60eee9644e31 for instance fd3907c4-f492-4501-80c7-d3d982a40af3 on hv-cinder-84733 Jun 29 11:39:36.132820 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-929ad45c-e943-48d8-95d8-bba63bca39f7 req-cc0478e6-8447-486d-9994-3ec580967944 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028237 Jun 29 11:39:36.133436 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 544/1090] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:39:36.872512 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e52cc4ac-f43c-47b4-bb25-a3435163549b tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:36.873241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e52cc4ac-f43c-47b4-bb25-a3435163549b tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:36.879912 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e52cc4ac-f43c-47b4-bb25-a3435163549b tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:36.880356 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e52cc4ac-f43c-47b4-bb25-a3435163549b tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:36.881116 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e52cc4ac-f43c-47b4-bb25-a3435163549b tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:36.881548 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e52cc4ac-f43c-47b4-bb25-a3435163549b tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:36.913406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e52cc4ac-f43c-47b4-bb25-a3435163549b tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:36.913853 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e52cc4ac-f43c-47b4-bb25-a3435163549b tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:36.914296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-e52cc4ac-f43c-47b4-bb25-a3435163549b tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lazy-loading 'fault' on Instance uuid fd3907c4-f492-4501-80c7-d3d982a40af3 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:39:36.956087 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e52cc4ac-f43c-47b4-bb25-a3435163549b tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:36.963880 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e52cc4ac-f43c-47b4-bb25-a3435163549b tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 200 len: 1309 microversion: 2.1 time: 0.095780 Jun 29 11:39:36.964434 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 547/1091] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:36 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:39:37.982527 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d2486520-3227-46a0-9eac-c7ff15d32285 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:37.983222 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d2486520-3227-46a0-9eac-c7ff15d32285 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: fd3907c4-f492-4501-80c7-d3d982a40af3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:37.989654 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2486520-3227-46a0-9eac-c7ff15d32285 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:37.990098 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2486520-3227-46a0-9eac-c7ff15d32285 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:37.990854 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2486520-3227-46a0-9eac-c7ff15d32285 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:37.991287 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2486520-3227-46a0-9eac-c7ff15d32285 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:38.004256 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-d2486520-3227-46a0-9eac-c7ff15d32285 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] HTTP exception thrown: Instance fd3907c4-f492-4501-80c7-d3d982a40af3 could not be found. Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d2486520-3227-46a0-9eac-c7ff15d32285 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Request method failure captured: Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 HTTP/1.1 Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDmwUMH7ik0z3dQgxeObZlxwCWLMuRcal6Iw2phsywcYqidlKz9x5PxxjtnIibLvb2b33_5du5ZcMfatzNogiNudXF1bAyRE6_HJ6lJg3m6qtTmHm-bjnX_I4TOUQNfIEcCGvfJvOtxPDSIHOZxBOES7ZKlXRsAPRo0DVxBo6YgeHg0 Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: db642fb7d52f4fdfa95cd85555c79af3 Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesSnapshotTestJSON-806219336 Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:39:38.005844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:39:38.007515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/db642fb7d52f4fdfa95cd85555c79af3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_db642fb7d52f4fdfa95cd85555c79af3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/db642fb7d52f4fdfa95cd85555c79af3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/db642fb7d52f4fdfa95cd85555c79af3"}]}] Jun 29 11:39:38.007515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesSnapshotTestJSON-806219336 Jun 29 11:39:38.007515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: db642fb7d52f4fdfa95cd85555c79af3 Jun 29 11:39:38.007515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-806219336 Jun 29 11:39:38.007515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesSnapshotTestJSON-806219336-project Jun 29 11:39:38.007515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:39:38.007515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:39:38.007515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 8c0159323d8d46ffb28b8071fcf0acf2 Jun 29 11:39:38.007515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesSnapshotTestJSON-806219336-project Jun 29 11:39:38.007515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:39:38.007515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance fd3907c4-f492-4501-80c7-d3d982a40af3 could not be found. Jun 29 11:39:38.007515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': 'fd3907c4-f492-4501-80c7-d3d982a40af3'} Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3907c4-f492-4501-80c7-d3d982a40af3 could not be found. Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:39:38.008623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3907c4-f492-4501-80c7-d3d982a40af3 could not be found. Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3907c4-f492-4501-80c7-d3d982a40af3 could not be found. Jun 29 11:39:38.010227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:39:38.011803 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d2486520-3227-46a0-9eac-c7ff15d32285 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Returning 404 to user: Instance fd3907c4-f492-4501-80c7-d3d982a40af3 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:39:38.011803 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d2486520-3227-46a0-9eac-c7ff15d32285 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3" status: 404 len: 111 microversion: 2.1 time: 0.029925 Jun 29 11:39:38.011803 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 545/1092] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:37 2022] GET /compute/v2.1/servers/fd3907c4-f492-4501-80c7-d3d982a40af3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:39:47.214529 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:39:47.215123 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Wed Jun 29 11:39:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:39:47.565225 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:39:47.565743 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Wed Jun 29 11:39:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:39:49.246973 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1117633741", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "networks": [{"uuid": "85d5219a-f67d-4d9b-bb48-f18ed7d85833"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:39:49.254100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=10 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:39:49.254747 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:39:49.299032 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] validate_networks() for [('85d5219a-f67d-4d9b-bb48-f18ed7d85833', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:39:49.641638 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:39:49.642059 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:39:49.642526 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:39:49.642928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:39:49.643356 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:39:49.652288 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:49.652738 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:49.653561 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:49.653998 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:49.670729 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Getting quotas for project db642fb7d52f4fdfa95cd85555c79af3. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:39:49.674615 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Getting quotas for user 8c0159323d8d46ffb28b8071fcf0acf2 and project db642fb7d52f4fdfa95cd85555c79af3. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:39:49.685689 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:39:49.687962 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:39:49.805047 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8059ad6f-0b02-429f-a892-52ad959c1c0a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562202 Jun 29 11:39:49.805620 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 548/1093] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:39:49.815868 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8725adbf-9ef5-467b-bacc-0c08a0b053e6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:49.816479 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8725adbf-9ef5-467b-bacc-0c08a0b053e6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:49.818919 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:39:49.819570 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:39:49.874176 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8725adbf-9ef5-467b-bacc-0c08a0b053e6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:49.881523 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8725adbf-9ef5-467b-bacc-0c08a0b053e6 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1219 microversion: 2.1 time: 0.069891 Jun 29 11:39:49.882076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 546/1094] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:49 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:39:50.898904 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e5702aa7-ada1-44e3-847a-f5568bea7162 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:50.899590 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5702aa7-ada1-44e3-847a-f5568bea7162 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:50.906552 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5702aa7-ada1-44e3-847a-f5568bea7162 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:50.907007 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5702aa7-ada1-44e3-847a-f5568bea7162 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:50.907766 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5702aa7-ada1-44e3-847a-f5568bea7162 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:50.908225 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5702aa7-ada1-44e3-847a-f5568bea7162 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:50.971025 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e5702aa7-ada1-44e3-847a-f5568bea7162 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:50.978346 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e5702aa7-ada1-44e3-847a-f5568bea7162 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1215 microversion: 2.1 time: 0.084110 Jun 29 11:39:50.978955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 549/1095] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:50 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:39:51.996053 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bdbaca05-d163-44e3-b6ef-8bf032b8f262 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:51.997266 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bdbaca05-d163-44e3-b6ef-8bf032b8f262 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:52.004920 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdbaca05-d163-44e3-b6ef-8bf032b8f262 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:52.006817 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdbaca05-d163-44e3-b6ef-8bf032b8f262 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:52.006817 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdbaca05-d163-44e3-b6ef-8bf032b8f262 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:52.006817 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdbaca05-d163-44e3-b6ef-8bf032b8f262 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:52.071201 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bdbaca05-d163-44e3-b6ef-8bf032b8f262 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:52.079074 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bdbaca05-d163-44e3-b6ef-8bf032b8f262 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1277 microversion: 2.1 time: 0.086971 Jun 29 11:39:52.079624 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 547/1096] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:51 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:39:53.096732 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-71eac264-a585-47e4-8632-7be39acb155d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:53.097456 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-71eac264-a585-47e4-8632-7be39acb155d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:53.103354 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71eac264-a585-47e4-8632-7be39acb155d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:53.103797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71eac264-a585-47e4-8632-7be39acb155d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:53.104581 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71eac264-a585-47e4-8632-7be39acb155d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:53.105010 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-71eac264-a585-47e4-8632-7be39acb155d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:53.233633 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-28a9e4e9-d2b3-429d-9439-6394a3862bf1 req-7edcedbd-402b-42a3-bf1a-4025c597089b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69f98ef-4506-4b53-a74f-761f41fb6c03", "tag": "c07842be-c5ec-4d52-a704-687a2c31235d"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:39:53.243400 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-28a9e4e9-d2b3-429d-9439-6394a3862bf1 req-7edcedbd-402b-42a3-bf1a-4025c597089b service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:53.243903 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-28a9e4e9-d2b3-429d-9439-6394a3862bf1 req-7edcedbd-402b-42a3-bf1a-4025c597089b service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:53.255037 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-28a9e4e9-d2b3-429d-9439-6394a3862bf1 req-7edcedbd-402b-42a3-bf1a-4025c597089b service nova] Creating event network-changed:c07842be-c5ec-4d52-a704-687a2c31235d for instance f69f98ef-4506-4b53-a74f-761f41fb6c03 on hv-cinder-84733 Jun 29 11:39:53.260287 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-28a9e4e9-d2b3-429d-9439-6394a3862bf1 req-7edcedbd-402b-42a3-bf1a-4025c597089b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035857 Jun 29 11:39:53.260906 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 548/1097] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:39:53.561838 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-71eac264-a585-47e4-8632-7be39acb155d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:53.570916 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-71eac264-a585-47e4-8632-7be39acb155d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1319 microversion: 2.1 time: 0.478117 Jun 29 11:39:53.571689 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 550/1098] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:53 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1319 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:39:54.589476 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f3bb3f04-843d-42d1-9c94-43971d262ef1 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:54.590238 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f3bb3f04-843d-42d1-9c94-43971d262ef1 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:54.597030 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3bb3f04-843d-42d1-9c94-43971d262ef1 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:54.597473 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3bb3f04-843d-42d1-9c94-43971d262ef1 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:54.598234 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3bb3f04-843d-42d1-9c94-43971d262ef1 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:54.598669 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3bb3f04-843d-42d1-9c94-43971d262ef1 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:54.726815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f3bb3f04-843d-42d1-9c94-43971d262ef1 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:54.734329 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f3bb3f04-843d-42d1-9c94-43971d262ef1 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1319 microversion: 2.1 time: 0.149570 Jun 29 11:39:54.734888 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 549/1099] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:54 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:39:55.750314 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bd10b3ea-0f05-4cf2-a4cf-bfba718cbe67 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:55.750922 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd10b3ea-0f05-4cf2-a4cf-bfba718cbe67 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:55.757353 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd10b3ea-0f05-4cf2-a4cf-bfba718cbe67 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:55.757797 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd10b3ea-0f05-4cf2-a4cf-bfba718cbe67 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:55.758548 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd10b3ea-0f05-4cf2-a4cf-bfba718cbe67 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:55.758981 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd10b3ea-0f05-4cf2-a4cf-bfba718cbe67 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:55.891928 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd10b3ea-0f05-4cf2-a4cf-bfba718cbe67 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:55.900614 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bd10b3ea-0f05-4cf2-a4cf-bfba718cbe67 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1319 microversion: 2.1 time: 0.154142 Jun 29 11:39:55.901166 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 551/1100] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:55 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:39:56.917844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3405fa6b-bbdf-4412-bec0-a394d8ad0191 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:56.918878 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3405fa6b-bbdf-4412-bec0-a394d8ad0191 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:56.925382 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3405fa6b-bbdf-4412-bec0-a394d8ad0191 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:56.925832 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3405fa6b-bbdf-4412-bec0-a394d8ad0191 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:56.926594 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3405fa6b-bbdf-4412-bec0-a394d8ad0191 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:56.927032 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3405fa6b-bbdf-4412-bec0-a394d8ad0191 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:57.055544 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3405fa6b-bbdf-4412-bec0-a394d8ad0191 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:57.063477 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3405fa6b-bbdf-4412-bec0-a394d8ad0191 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1319 microversion: 2.1 time: 0.149654 Jun 29 11:39:57.064064 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 550/1101] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:56 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:39:58.080769 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ede8c559-6d87-4630-8f5b-3bec40523cc2 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:58.081390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ede8c559-6d87-4630-8f5b-3bec40523cc2 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:58.087784 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ede8c559-6d87-4630-8f5b-3bec40523cc2 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:58.088261 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ede8c559-6d87-4630-8f5b-3bec40523cc2 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:58.089021 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ede8c559-6d87-4630-8f5b-3bec40523cc2 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:58.089456 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ede8c559-6d87-4630-8f5b-3bec40523cc2 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:58.327886 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ede8c559-6d87-4630-8f5b-3bec40523cc2 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:58.335163 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ede8c559-6d87-4630-8f5b-3bec40523cc2 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1319 microversion: 2.1 time: 0.258305 Jun 29 11:39:58.335718 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 552/1102] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:58 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:39:59.351694 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-02b4d6a4-ef8e-46a4-9b7a-5aaab563b923 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:39:59.352268 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-02b4d6a4-ef8e-46a4-9b7a-5aaab563b923 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:39:59.359221 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02b4d6a4-ef8e-46a4-9b7a-5aaab563b923 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:59.359664 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02b4d6a4-ef8e-46a4-9b7a-5aaab563b923 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:59.360454 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02b4d6a4-ef8e-46a4-9b7a-5aaab563b923 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:39:59.360888 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-02b4d6a4-ef8e-46a4-9b7a-5aaab563b923 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:39:59.490184 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-02b4d6a4-ef8e-46a4-9b7a-5aaab563b923 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:39:59.497592 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-02b4d6a4-ef8e-46a4-9b7a-5aaab563b923 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1319 microversion: 2.1 time: 0.149759 Jun 29 11:39:59.498159 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 551/1103] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:39:59 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:40:00.515438 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a9a6ffd8-15a1-4212-8337-22c1ce3d0831 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:00.516073 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a9a6ffd8-15a1-4212-8337-22c1ce3d0831 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:00.518349 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:00.518994 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:00.523776 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9a6ffd8-15a1-4212-8337-22c1ce3d0831 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:00.524245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9a6ffd8-15a1-4212-8337-22c1ce3d0831 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:00.524992 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9a6ffd8-15a1-4212-8337-22c1ce3d0831 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:00.525423 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9a6ffd8-15a1-4212-8337-22c1ce3d0831 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:00.652129 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a9a6ffd8-15a1-4212-8337-22c1ce3d0831 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:40:00.659619 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a9a6ffd8-15a1-4212-8337-22c1ce3d0831 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1319 microversion: 2.1 time: 0.149015 Jun 29 11:40:00.660213 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 553/1104] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:40:00 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:40:01.016830 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-5dcf8410-9503-483b-8242-4bffe9cd7694 req-8c522851-b585-435b-a324-75a26f04e4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69f98ef-4506-4b53-a74f-761f41fb6c03", "name": "network-vif-plugged", "status": "completed", "tag": "c07842be-c5ec-4d52-a704-687a2c31235d"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:40:01.020478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:01.026033 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-5dcf8410-9503-483b-8242-4bffe9cd7694 req-8c522851-b585-435b-a324-75a26f04e4eb service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:01.026468 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-5dcf8410-9503-483b-8242-4bffe9cd7694 req-8c522851-b585-435b-a324-75a26f04e4eb service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:01.037648 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-5dcf8410-9503-483b-8242-4bffe9cd7694 req-8c522851-b585-435b-a324-75a26f04e4eb service nova] Creating event network-vif-plugged:c07842be-c5ec-4d52-a704-687a2c31235d for instance f69f98ef-4506-4b53-a74f-761f41fb6c03 on hv-cinder-84733 Jun 29 11:40:01.042543 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-5dcf8410-9503-483b-8242-4bffe9cd7694 req-8c522851-b585-435b-a324-75a26f04e4eb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030803 Jun 29 11:40:01.043125 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 552/1105] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:40:01.676554 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eb8eeb72-6c44-40cd-b6e3-04de3e6edd23 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:01.677091 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eb8eeb72-6c44-40cd-b6e3-04de3e6edd23 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:01.683478 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb8eeb72-6c44-40cd-b6e3-04de3e6edd23 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:01.683962 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb8eeb72-6c44-40cd-b6e3-04de3e6edd23 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:01.685313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb8eeb72-6c44-40cd-b6e3-04de3e6edd23 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:01.685747 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb8eeb72-6c44-40cd-b6e3-04de3e6edd23 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:01.810640 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eb8eeb72-6c44-40cd-b6e3-04de3e6edd23 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:40:01.818126 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eb8eeb72-6c44-40cd-b6e3-04de3e6edd23 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1319 microversion: 2.1 time: 0.145568 Jun 29 11:40:01.818682 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 554/1106] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:40:01 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:40:02.835489 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c838ba7c-4d54-444f-952c-df05e336864e tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:02.836240 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c838ba7c-4d54-444f-952c-df05e336864e tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:02.843918 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c838ba7c-4d54-444f-952c-df05e336864e tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:02.844368 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c838ba7c-4d54-444f-952c-df05e336864e tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:02.845130 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c838ba7c-4d54-444f-952c-df05e336864e tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:02.845569 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c838ba7c-4d54-444f-952c-df05e336864e tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:02.974596 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c838ba7c-4d54-444f-952c-df05e336864e tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:40:02.981979 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c838ba7c-4d54-444f-952c-df05e336864e tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1319 microversion: 2.1 time: 0.151225 Jun 29 11:40:02.982533 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 553/1107] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:40:02 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:40:03.999103 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dbb74458-d9c9-4e67-91bf-04a25800b354 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:03.999718 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dbb74458-d9c9-4e67-91bf-04a25800b354 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:04.006465 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbb74458-d9c9-4e67-91bf-04a25800b354 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:04.006918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbb74458-d9c9-4e67-91bf-04a25800b354 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:04.007684 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbb74458-d9c9-4e67-91bf-04a25800b354 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:04.008159 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbb74458-d9c9-4e67-91bf-04a25800b354 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:04.140623 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dbb74458-d9c9-4e67-91bf-04a25800b354 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:40:04.147903 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dbb74458-d9c9-4e67-91bf-04a25800b354 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1507 microversion: 2.1 time: 0.152677 Jun 29 11:40:04.148458 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 555/1108] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:40:03 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:40:04.164442 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-920a10ae-b78d-40bb-92ee-56561d612e36 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9a61c86-8bcb-4308-b3da-a95a04830a6b", "device": "/dev/sdb"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:40:04.165531 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-920a10ae-b78d-40bb-92ee-56561d612e36 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:04.172298 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-920a10ae-b78d-40bb-92ee-56561d612e36 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:04.172676 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-920a10ae-b78d-40bb-92ee-56561d612e36 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:04.174319 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-920a10ae-b78d-40bb-92ee-56561d612e36 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:04.174319 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-920a10ae-b78d-40bb-92ee-56561d612e36 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:04.904242 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-920a10ae-b78d-40bb-92ee-56561d612e36 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "POST /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.743464 Jun 29 11:40:04.904862 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 554/1109] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:40:04 2022] POST /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03/os-volume_attachments => generated 194 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:40:26.769807 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e531644e-50f9-4446-8c45-11acb2ef4d89 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:26.770313 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e531644e-50f9-4446-8c45-11acb2ef4d89 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:26.772443 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:26.773128 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=44 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:26.777995 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e531644e-50f9-4446-8c45-11acb2ef4d89 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:26.781648 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e531644e-50f9-4446-8c45-11acb2ef4d89 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:26.781648 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e531644e-50f9-4446-8c45-11acb2ef4d89 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:26.781648 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e531644e-50f9-4446-8c45-11acb2ef4d89 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:26.861147 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-e531644e-50f9-4446-8c45-11acb2ef4d89 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lazy-loading 'services' on Instance uuid f69f98ef-4506-4b53-a74f-761f41fb6c03 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:40:27.081624 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e531644e-50f9-4446-8c45-11acb2ef4d89 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03/os-volume_attachments/a9a61c86-8bcb-4308-b3da-a95a04830a6b" status: 202 len: 0 microversion: 2.1 time: 0.315449 Jun 29 11:40:27.082188 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 556/1110] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jun 29 11:40:26 2022] DELETE /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03/os-volume_attachments/a9a61c86-8bcb-4308-b3da-a95a04830a6b => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:40:29.252013 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fc891c32-fd70-4cc6-860f-2e7bbf11fd40 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:29.252627 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fc891c32-fd70-4cc6-860f-2e7bbf11fd40 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:29.255123 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=20 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:29.255797 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:29.260732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc891c32-fd70-4cc6-860f-2e7bbf11fd40 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:29.261171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc891c32-fd70-4cc6-860f-2e7bbf11fd40 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:29.261928 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc891c32-fd70-4cc6-860f-2e7bbf11fd40 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:29.262358 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc891c32-fd70-4cc6-860f-2e7bbf11fd40 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:29.288038 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fc891c32-fd70-4cc6-860f-2e7bbf11fd40 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:40:29.573773 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fc891c32-fd70-4cc6-860f-2e7bbf11fd40 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 204 len: 0 microversion: 2.1 time: 0.325643 Jun 29 11:40:29.574333 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 555/1111] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:40:29 2022] DELETE /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:40:29.583449 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb3641d3-24ca-4c58-adf5-dccd1f9cce3d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:29.584187 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb3641d3-24ca-4c58-adf5-dccd1f9cce3d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:29.591229 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb3641d3-24ca-4c58-adf5-dccd1f9cce3d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:29.591680 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb3641d3-24ca-4c58-adf5-dccd1f9cce3d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:29.592481 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb3641d3-24ca-4c58-adf5-dccd1f9cce3d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:29.592919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb3641d3-24ca-4c58-adf5-dccd1f9cce3d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:29.722517 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb3641d3-24ca-4c58-adf5-dccd1f9cce3d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:40:29.729785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb3641d3-24ca-4c58-adf5-dccd1f9cce3d tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1513 microversion: 2.1 time: 0.151116 Jun 29 11:40:29.730345 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 557/1112] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:40:29 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:40:30.748964 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6b21c8bc-9d66-4147-a8ad-dd6aab2e00bf tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:30.749648 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6b21c8bc-9d66-4147-a8ad-dd6aab2e00bf tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:30.756709 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b21c8bc-9d66-4147-a8ad-dd6aab2e00bf tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:30.757144 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b21c8bc-9d66-4147-a8ad-dd6aab2e00bf tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:30.757921 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b21c8bc-9d66-4147-a8ad-dd6aab2e00bf tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:30.758347 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b21c8bc-9d66-4147-a8ad-dd6aab2e00bf tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:30.940605 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6b21c8bc-9d66-4147-a8ad-dd6aab2e00bf tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:40:30.948094 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6b21c8bc-9d66-4147-a8ad-dd6aab2e00bf tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1513 microversion: 2.1 time: 0.203485 Jun 29 11:40:30.948656 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 556/1113] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:40:30 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:40:31.964918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-17dd7fa1-ecae-4ebd-966d-d70f655ba419 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:31.965635 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-17dd7fa1-ecae-4ebd-966d-d70f655ba419 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:31.972072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17dd7fa1-ecae-4ebd-966d-d70f655ba419 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:31.972516 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17dd7fa1-ecae-4ebd-966d-d70f655ba419 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:31.973269 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17dd7fa1-ecae-4ebd-966d-d70f655ba419 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:31.973700 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17dd7fa1-ecae-4ebd-966d-d70f655ba419 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:32.138095 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-17dd7fa1-ecae-4ebd-966d-d70f655ba419 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:40:32.145609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-17dd7fa1-ecae-4ebd-966d-d70f655ba419 tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1513 microversion: 2.1 time: 0.184572 Jun 29 11:40:32.146166 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 558/1114] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:40:31 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:40:32.253722 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-574fb19a-1e66-4b6f-81d6-6a9be3855b79 req-f03976b7-b779-4040-8862-c4e97c01e40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69f98ef-4506-4b53-a74f-761f41fb6c03", "name": "network-vif-deleted", "tag": "c07842be-c5ec-4d52-a704-687a2c31235d"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:40:32.269257 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-574fb19a-1e66-4b6f-81d6-6a9be3855b79 req-f03976b7-b779-4040-8862-c4e97c01e40b service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:32.270054 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-574fb19a-1e66-4b6f-81d6-6a9be3855b79 req-f03976b7-b779-4040-8862-c4e97c01e40b service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:32.288949 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-574fb19a-1e66-4b6f-81d6-6a9be3855b79 req-f03976b7-b779-4040-8862-c4e97c01e40b service nova] Creating event network-vif-deleted:c07842be-c5ec-4d52-a704-687a2c31235d for instance f69f98ef-4506-4b53-a74f-761f41fb6c03 on hv-cinder-84733 Jun 29 11:40:32.293808 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-574fb19a-1e66-4b6f-81d6-6a9be3855b79 req-f03976b7-b779-4040-8862-c4e97c01e40b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044384 Jun 29 11:40:32.294548 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 557/1115] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:40:33.162576 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6af893ca-e3a9-4780-aa9b-2ace7eeeed5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:33.163484 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6af893ca-e3a9-4780-aa9b-2ace7eeeed5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:33.170901 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6af893ca-e3a9-4780-aa9b-2ace7eeeed5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:33.171581 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6af893ca-e3a9-4780-aa9b-2ace7eeeed5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:33.172433 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6af893ca-e3a9-4780-aa9b-2ace7eeeed5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:33.172943 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6af893ca-e3a9-4780-aa9b-2ace7eeeed5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:33.206345 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6af893ca-e3a9-4780-aa9b-2ace7eeeed5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:33.206785 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6af893ca-e3a9-4780-aa9b-2ace7eeeed5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:33.207235 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-6af893ca-e3a9-4780-aa9b-2ace7eeeed5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lazy-loading 'fault' on Instance uuid f69f98ef-4506-4b53-a74f-761f41fb6c03 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:40:33.250842 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6af893ca-e3a9-4780-aa9b-2ace7eeeed5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c0159323d8d46ffb28b8071fcf0acf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db642fb7d52f4fdfa95cd85555c79af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:40:33.258150 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6af893ca-e3a9-4780-aa9b-2ace7eeeed5a tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 200 len: 1309 microversion: 2.1 time: 0.099533 Jun 29 11:40:33.258705 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 559/1116] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:40:33 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:40:34.277675 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-52dfa7be-2998-4764-a40d-4b33d9f0baea tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:34.278361 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-52dfa7be-2998-4764-a40d-4b33d9f0baea tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] [instance: f69f98ef-4506-4b53-a74f-761f41fb6c03] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:34.285500 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52dfa7be-2998-4764-a40d-4b33d9f0baea tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:34.285941 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52dfa7be-2998-4764-a40d-4b33d9f0baea tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:34.286814 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52dfa7be-2998-4764-a40d-4b33d9f0baea tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:34.287253 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52dfa7be-2998-4764-a40d-4b33d9f0baea tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:34.310564 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-52dfa7be-2998-4764-a40d-4b33d9f0baea tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] HTTP exception thrown: Instance f69f98ef-4506-4b53-a74f-761f41fb6c03 could not be found. Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-52dfa7be-2998-4764-a40d-4b33d9f0baea tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Request method failure captured: Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 HTTP/1.1 Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDmwUMH7ik0z3dQgxeObZlxwCWLMuRcal6Iw2phsywcYqidlKz9x5PxxjtnIibLvb2b33_5du5ZcMfatzNogiNudXF1bAyRE6_HJ6lJg3m6qtTmHm-bjnX_I4TOUQNfIEcCGvfJvOtxPDSIHOZxBOES7ZKlXRsAPRo0DVxBo6YgeHg0 Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: db642fb7d52f4fdfa95cd85555c79af3 Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesSnapshotTestJSON-806219336 Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:40:34.312342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:40:34.314045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/db642fb7d52f4fdfa95cd85555c79af3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_db642fb7d52f4fdfa95cd85555c79af3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/db642fb7d52f4fdfa95cd85555c79af3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/db642fb7d52f4fdfa95cd85555c79af3"}]}] Jun 29 11:40:34.314045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesSnapshotTestJSON-806219336 Jun 29 11:40:34.314045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: db642fb7d52f4fdfa95cd85555c79af3 Jun 29 11:40:34.314045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-806219336 Jun 29 11:40:34.314045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesSnapshotTestJSON-806219336-project Jun 29 11:40:34.314045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:40:34.314045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:40:34.314045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 8c0159323d8d46ffb28b8071fcf0acf2 Jun 29 11:40:34.314045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesSnapshotTestJSON-806219336-project Jun 29 11:40:34.314045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:40:34.314045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance f69f98ef-4506-4b53-a74f-761f41fb6c03 could not be found. Jun 29 11:40:34.314045 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': 'f69f98ef-4506-4b53-a74f-761f41fb6c03'} Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f69f98ef-4506-4b53-a74f-761f41fb6c03 could not be found. Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:40:34.315021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f69f98ef-4506-4b53-a74f-761f41fb6c03 could not be found. Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f69f98ef-4506-4b53-a74f-761f41fb6c03 could not be found. Jun 29 11:40:34.316658 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:40:34.318299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-52dfa7be-2998-4764-a40d-4b33d9f0baea tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] Returning 404 to user: Instance f69f98ef-4506-4b53-a74f-761f41fb6c03 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:40:34.318299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-52dfa7be-2998-4764-a40d-4b33d9f0baea tempest-VolumesSnapshotTestJSON-806219336 tempest-VolumesSnapshotTestJSON-806219336-project] 10.222.0.44 "GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03" status: 404 len: 111 microversion: 2.1 time: 0.041008 Jun 29 11:40:34.318299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 558/1117] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:40:34 2022] GET /compute/v2.1/servers/f69f98ef-4506-4b53-a74f-761f41fb6c03 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:40:42.211252 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-39d1653c-6b17-4dd1-848b-b4e3a86eb528 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:42.211768 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-39d1653c-6b17-4dd1-848b-b4e3a86eb528 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:42.218496 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d1653c-6b17-4dd1-848b-b4e3a86eb528 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:42.218950 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d1653c-6b17-4dd1-848b-b4e3a86eb528 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:42.219718 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d1653c-6b17-4dd1-848b-b4e3a86eb528 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:42.220186 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39d1653c-6b17-4dd1-848b-b4e3a86eb528 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:42.244418 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-39d1653c-6b17-4dd1-848b-b4e3a86eb528 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/ips" status: 200 len: 150 microversion: 2.1 time: 0.036950 Jun 29 11:40:42.244996 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 560/1118] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jun 29 11:40:42 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:40:44.890739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fe95e400-c6cc-4df2-86ce-c58d799a93f5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3069493-7e74-4a28-b2b2-284df3141ef5"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:40:44.895973 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fe95e400-c6cc-4df2-86ce-c58d799a93f5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:44.895973 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:44.895973 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:44.900280 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe95e400-c6cc-4df2-86ce-c58d799a93f5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:44.900786 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe95e400-c6cc-4df2-86ce-c58d799a93f5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:44.901548 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe95e400-c6cc-4df2-86ce-c58d799a93f5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:44.901979 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe95e400-c6cc-4df2-86ce-c58d799a93f5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:45.789750 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fe95e400-c6cc-4df2-86ce-c58d799a93f5 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "POST /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.902629 Jun 29 11:40:45.790277 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 559/1119] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jun 29 11:40:44 2022] POST /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/os-volume_attachments => generated 194 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:40:55.464533 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-404d106f-8b31-4f46-b4e6-ef1cd58476f7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:55.465315 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-404d106f-8b31-4f46-b4e6-ef1cd58476f7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:55.467070 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=12 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:55.467729 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:55.472978 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-404d106f-8b31-4f46-b4e6-ef1cd58476f7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:55.473422 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-404d106f-8b31-4f46-b4e6-ef1cd58476f7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:55.474176 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-404d106f-8b31-4f46-b4e6-ef1cd58476f7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:55.474611 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-404d106f-8b31-4f46-b4e6-ef1cd58476f7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:55.551898 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-404d106f-8b31-4f46-b4e6-ef1cd58476f7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lazy-loading 'services' on Instance uuid 5a3566a4-3530-4d09-b0f4-954ed471e75b {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:40:55.859473 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-404d106f-8b31-4f46-b4e6-ef1cd58476f7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/os-volume_attachments/b3069493-7e74-4a28-b2b2-284df3141ef5" status: 202 len: 0 microversion: 2.1 time: 0.398816 Jun 29 11:40:55.862677 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 561/1120] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jun 29 11:40:55 2022] DELETE /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/os-volume_attachments/b3069493-7e74-4a28-b2b2-284df3141ef5 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:40:55.869406 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f7b71fb1-e86c-49ea-894b-e15c0016011a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:55.870492 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f7b71fb1-e86c-49ea-894b-e15c0016011a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:55.872980 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:55.873674 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:40:55.879546 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7b71fb1-e86c-49ea-894b-e15c0016011a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:55.881005 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7b71fb1-e86c-49ea-894b-e15c0016011a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:55.881987 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7b71fb1-e86c-49ea-894b-e15c0016011a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:55.882590 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7b71fb1-e86c-49ea-894b-e15c0016011a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:55.920418 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f7b71fb1-e86c-49ea-894b-e15c0016011a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055481 Jun 29 11:40:55.921255 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 560/1121] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:40:55 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:40:56.933587 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f3368602-7767-4420-a2e4-842d14ebc09a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:56.936076 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f3368602-7767-4420-a2e4-842d14ebc09a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:56.940937 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3368602-7767-4420-a2e4-842d14ebc09a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:56.941386 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3368602-7767-4420-a2e4-842d14ebc09a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:56.942235 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3368602-7767-4420-a2e4-842d14ebc09a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:56.942674 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3368602-7767-4420-a2e4-842d14ebc09a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:56.972534 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f3368602-7767-4420-a2e4-842d14ebc09a tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 Jun 29 11:40:56.973091 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 562/1122] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:40:56 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:40:57.984739 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b2d35ce8-61d2-4eb8-a49c-9fc0911719c0 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:57.985604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b2d35ce8-61d2-4eb8-a49c-9fc0911719c0 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:57.993464 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2d35ce8-61d2-4eb8-a49c-9fc0911719c0 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:57.993892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2d35ce8-61d2-4eb8-a49c-9fc0911719c0 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:57.994655 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2d35ce8-61d2-4eb8-a49c-9fc0911719c0 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:57.995091 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b2d35ce8-61d2-4eb8-a49c-9fc0911719c0 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:58.023424 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b2d35ce8-61d2-4eb8-a49c-9fc0911719c0 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043416 Jun 29 11:40:58.023999 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 561/1123] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jun 29 11:40:57 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 11:40:58.079572 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dd830303-3a66-4d8e-b80e-ae1431fdb588 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:58.080196 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dd830303-3a66-4d8e-b80e-ae1431fdb588 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:58.086495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd830303-3a66-4d8e-b80e-ae1431fdb588 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:58.086936 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd830303-3a66-4d8e-b80e-ae1431fdb588 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:58.087711 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd830303-3a66-4d8e-b80e-ae1431fdb588 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:58.088167 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd830303-3a66-4d8e-b80e-ae1431fdb588 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:58.113372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dd830303-3a66-4d8e-b80e-ae1431fdb588 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:40:58.430171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dd830303-3a66-4d8e-b80e-ae1431fdb588 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 204 len: 0 microversion: 2.1 time: 0.354023 Jun 29 11:40:58.430763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 563/1124] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:40:58 2022] DELETE /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:40:58.439474 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6232d592-ba0a-4ca7-8750-b3b3c63a408d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:58.440110 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6232d592-ba0a-4ca7-8750-b3b3c63a408d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:58.446115 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6232d592-ba0a-4ca7-8750-b3b3c63a408d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:58.446549 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6232d592-ba0a-4ca7-8750-b3b3c63a408d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:58.447292 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6232d592-ba0a-4ca7-8750-b3b3c63a408d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:58.447718 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6232d592-ba0a-4ca7-8750-b3b3c63a408d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:58.581473 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6232d592-ba0a-4ca7-8750-b3b3c63a408d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:40:58.589187 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6232d592-ba0a-4ca7-8750-b3b3c63a408d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1681 microversion: 2.1 time: 0.153937 Jun 29 11:40:58.593008 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 562/1125] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:40:58 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:40:59.606718 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f62db8b7-ed49-426c-ac91-efe7e8e5b7ac tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:40:59.609113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f62db8b7-ed49-426c-ac91-efe7e8e5b7ac tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:40:59.615081 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f62db8b7-ed49-426c-ac91-efe7e8e5b7ac tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:59.615527 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f62db8b7-ed49-426c-ac91-efe7e8e5b7ac tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:59.616323 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f62db8b7-ed49-426c-ac91-efe7e8e5b7ac tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:40:59.616752 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f62db8b7-ed49-426c-ac91-efe7e8e5b7ac tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:40:59.754837 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f62db8b7-ed49-426c-ac91-efe7e8e5b7ac tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:40:59.757099 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f62db8b7-ed49-426c-ac91-efe7e8e5b7ac tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1681 microversion: 2.1 time: 0.154531 Jun 29 11:40:59.757655 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 564/1126] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:40:59 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:00.774662 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1a6a5425-92ae-4a15-9889-60bb8d33329d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:00.775280 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1a6a5425-92ae-4a15-9889-60bb8d33329d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:00.781928 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a6a5425-92ae-4a15-9889-60bb8d33329d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:00.782375 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a6a5425-92ae-4a15-9889-60bb8d33329d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:00.789146 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a6a5425-92ae-4a15-9889-60bb8d33329d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:00.789146 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1a6a5425-92ae-4a15-9889-60bb8d33329d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:01.024698 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1a6a5425-92ae-4a15-9889-60bb8d33329d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:01.033732 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1a6a5425-92ae-4a15-9889-60bb8d33329d tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1681 microversion: 2.1 time: 0.263125 Jun 29 11:41:01.034317 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 563/1127] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:00 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:01.409507 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-dd0d5762-5ad3-41d1-9c77-df959f2d5309 req-6dacce70-87e1-40db-98ba-4cb6d88e1a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3566a4-3530-4d09-b0f4-954ed471e75b", "name": "network-vif-deleted", "tag": "3ec8214a-e957-4cb6-afc7-e5122f68d64e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:41:01.418448 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-dd0d5762-5ad3-41d1-9c77-df959f2d5309 req-6dacce70-87e1-40db-98ba-4cb6d88e1a48 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:01.418899 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-dd0d5762-5ad3-41d1-9c77-df959f2d5309 req-6dacce70-87e1-40db-98ba-4cb6d88e1a48 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:01.430852 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-dd0d5762-5ad3-41d1-9c77-df959f2d5309 req-6dacce70-87e1-40db-98ba-4cb6d88e1a48 service nova] Creating event network-vif-deleted:3ec8214a-e957-4cb6-afc7-e5122f68d64e for instance 5a3566a4-3530-4d09-b0f4-954ed471e75b on hv-cinder-84733 Jun 29 11:41:01.436236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-dd0d5762-5ad3-41d1-9c77-df959f2d5309 req-6dacce70-87e1-40db-98ba-4cb6d88e1a48 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031257 Jun 29 11:41:01.437022 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 565/1128] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:41:02.050241 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-46aa13d3-3a9b-4112-bec6-339fee6bfabd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:02.051014 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-46aa13d3-3a9b-4112-bec6-339fee6bfabd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:02.060723 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-46aa13d3-3a9b-4112-bec6-339fee6bfabd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:02.061164 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-46aa13d3-3a9b-4112-bec6-339fee6bfabd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:02.061927 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-46aa13d3-3a9b-4112-bec6-339fee6bfabd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:02.062358 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-46aa13d3-3a9b-4112-bec6-339fee6bfabd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:02.099158 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-46aa13d3-3a9b-4112-bec6-339fee6bfabd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:02.099602 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-46aa13d3-3a9b-4112-bec6-339fee6bfabd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:02.100071 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-46aa13d3-3a9b-4112-bec6-339fee6bfabd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lazy-loading 'fault' on Instance uuid 5a3566a4-3530-4d09-b0f4-954ed471e75b {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:41:02.145567 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-46aa13d3-3a9b-4112-bec6-339fee6bfabd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7bc4681c954c158a7051046bd9aa47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c9a1ff3c46dcbe4464f57534e5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:02.153815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-46aa13d3-3a9b-4112-bec6-339fee6bfabd tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 200 len: 1331 microversion: 2.1 time: 0.107360 Jun 29 11:41:02.154488 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 564/1129] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:02 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:03.171671 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf2df328-3d67-4c9e-8806-90bbec9f7784 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:03.172348 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf2df328-3d67-4c9e-8806-90bbec9f7784 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:03.179504 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf2df328-3d67-4c9e-8806-90bbec9f7784 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:03.179998 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf2df328-3d67-4c9e-8806-90bbec9f7784 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:03.180756 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf2df328-3d67-4c9e-8806-90bbec9f7784 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:03.181186 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf2df328-3d67-4c9e-8806-90bbec9f7784 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:03.194826 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-cf2df328-3d67-4c9e-8806-90bbec9f7784 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf2df328-3d67-4c9e-8806-90bbec9f7784 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b HTTP/1.1 Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:41:03.196454 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:41:03.198211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:41:03.198211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:03.198211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:03.198211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:03.198211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:03.198211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:41:03.198211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:41:03.198211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:41:03.198211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:03.198211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:41:03.198211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:03.198211 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '5a3566a4-3530-4d09-b0f4-954ed471e75b'} Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:41:03.199171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:03.200833 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:03.202200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf2df328-3d67-4c9e-8806-90bbec9f7784 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 404 to user: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:41:03.202200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf2df328-3d67-4c9e-8806-90bbec9f7784 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 404 len: 111 microversion: 2.1 time: 0.030491 Jun 29 11:41:03.202200 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 566/1130] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:03 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:41:03.206676 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-85ba0d48-f1b0-4366-b007-d86adea22fb7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '.version_select at 0x7fd0894c19d0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:03.282809 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-85ba0d48-f1b0-4366-b007-d86adea22fb7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719128933" status: 202 len: 0 microversion: 2.1 time: 0.079878 Jun 29 11:41:03.283349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 565/1131] 10.222.0.44 () {58 vars in 1220 bytes} [Wed Jun 29 11:41:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719128933 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:41:05.329157 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3fb53fab-c7f5-455b-8d48-81f239991c2f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:05.329667 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3fb53fab-c7f5-455b-8d48-81f239991c2f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:05.336759 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fb53fab-c7f5-455b-8d48-81f239991c2f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:05.337212 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fb53fab-c7f5-455b-8d48-81f239991c2f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:05.337980 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fb53fab-c7f5-455b-8d48-81f239991c2f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:05.338419 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fb53fab-c7f5-455b-8d48-81f239991c2f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:05.352424 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-3fb53fab-c7f5-455b-8d48-81f239991c2f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3fb53fab-c7f5-455b-8d48-81f239991c2f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b HTTP/1.1 Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:41:05.354286 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:41:05.355989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:41:05.355989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:05.355989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:05.355989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:05.355989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:05.355989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:41:05.355989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:41:05.355989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:41:05.355989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:05.355989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:41:05.355989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:05.355989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '5a3566a4-3530-4d09-b0f4-954ed471e75b'} Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:41:05.356919 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:05.358495 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:05.359956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3fb53fab-c7f5-455b-8d48-81f239991c2f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 404 to user: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:41:05.359956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3fb53fab-c7f5-455b-8d48-81f239991c2f tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 404 len: 111 microversion: 2.1 time: 0.030396 Jun 29 11:41:05.359956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 567/1132] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:41:05 2022] DELETE /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:41:05.364583 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1c737932-8d61-4c7a-abff-e07c7c8c133b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:05.365196 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1c737932-8d61-4c7a-abff-e07c7c8c133b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 5a3566a4-3530-4d09-b0f4-954ed471e75b] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:05.372588 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c737932-8d61-4c7a-abff-e07c7c8c133b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:05.373038 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c737932-8d61-4c7a-abff-e07c7c8c133b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:05.373818 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c737932-8d61-4c7a-abff-e07c7c8c133b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:05.374243 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c737932-8d61-4c7a-abff-e07c7c8c133b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:05.387108 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-1c737932-8d61-4c7a-abff-e07c7c8c133b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1c737932-8d61-4c7a-abff-e07c7c8c133b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b HTTP/1.1 Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:41:05.388821 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:41:05.390349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:41:05.390349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:05.390349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:05.390349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:05.390349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:05.390349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:41:05.390349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:41:05.390349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:41:05.390349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:05.390349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:41:05.390349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:05.390349 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': '5a3566a4-3530-4d09-b0f4-954ed471e75b'} Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:41:05.391297 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. Jun 29 11:41:05.392853 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:05.394703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1c737932-8d61-4c7a-abff-e07c7c8c133b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 404 to user: Instance 5a3566a4-3530-4d09-b0f4-954ed471e75b could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:41:05.394703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1c737932-8d61-4c7a-abff-e07c7c8c133b tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b" status: 404 len: 111 microversion: 2.1 time: 0.029719 Jun 29 11:41:05.394703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 566/1133] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:05 2022] GET /compute/v2.1/servers/5a3566a4-3530-4d09-b0f4-954ed471e75b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 11:41:06.656165 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f4832e8-6b46-4a79-9c63-0a1852661ec1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:06.656656 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8f4832e8-6b46-4a79-9c63-0a1852661ec1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:06.663952 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f4832e8-6b46-4a79-9c63-0a1852661ec1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:06.664408 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f4832e8-6b46-4a79-9c63-0a1852661ec1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:06.665275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f4832e8-6b46-4a79-9c63-0a1852661ec1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:06.666236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8f4832e8-6b46-4a79-9c63-0a1852661ec1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:06.679726 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-8f4832e8-6b46-4a79-9c63-0a1852661ec1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f4832e8-6b46-4a79-9c63-0a1852661ec1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 HTTP/1.1 Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:41:06.681296 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:41:06.682955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:41:06.682955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:06.682955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:06.682955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:06.682955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:06.682955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:41:06.682955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:41:06.682955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:41:06.682955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:06.682955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:41:06.682955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:41:06.682955 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2'} Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:41:06.684072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:41:06.685672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.687262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8f4832e8-6b46-4a79-9c63-0a1852661ec1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 404 to user: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:41:06.687262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8f4832e8-6b46-4a79-9c63-0a1852661ec1 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 404 len: 111 microversion: 2.1 time: 0.030390 Jun 29 11:41:06.687262 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 568/1134] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:41:06 2022] DELETE /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:41:06.691133 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5af27fb2-f6b3-42ce-9968-69fe7090d3cb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:06.691747 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5af27fb2-f6b3-42ce-9968-69fe7090d3cb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:06.698557 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5af27fb2-f6b3-42ce-9968-69fe7090d3cb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:06.698996 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5af27fb2-f6b3-42ce-9968-69fe7090d3cb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:06.699745 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5af27fb2-f6b3-42ce-9968-69fe7090d3cb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:06.700234 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5af27fb2-f6b3-42ce-9968-69fe7090d3cb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:06.713584 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-5af27fb2-f6b3-42ce-9968-69fe7090d3cb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5af27fb2-f6b3-42ce-9968-69fe7090d3cb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 HTTP/1.1 Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:41:06.715081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:41:06.716699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:41:06.716699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:06.716699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:06.716699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:06.716699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:06.716699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:41:06.716699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:41:06.716699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:41:06.716699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:06.716699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:41:06.716699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:41:06.716699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': '69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2'} Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:41:06.717754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. Jun 29 11:41:06.719299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.720822 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5af27fb2-f6b3-42ce-9968-69fe7090d3cb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 404 to user: Instance 69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:41:06.720822 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5af27fb2-f6b3-42ce-9968-69fe7090d3cb tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2" status: 404 len: 111 microversion: 2.1 time: 0.029119 Jun 29 11:41:06.720822 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 567/1135] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:06 2022] GET /compute/v2.1/servers/69ebfbdd-7c4d-44f5-a0b2-8ee9333e86c2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:41:06.725169 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dca8311a-7960-4694-a3a1-5b0b7c3be9c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:06.725709 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dca8311a-7960-4694-a3a1-5b0b7c3be9c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:06.731582 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dca8311a-7960-4694-a3a1-5b0b7c3be9c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:06.732133 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dca8311a-7960-4694-a3a1-5b0b7c3be9c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:06.732878 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dca8311a-7960-4694-a3a1-5b0b7c3be9c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:06.733310 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dca8311a-7960-4694-a3a1-5b0b7c3be9c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:06.747291 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-dca8311a-7960-4694-a3a1-5b0b7c3be9c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dca8311a-7960-4694-a3a1-5b0b7c3be9c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 HTTP/1.1 Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:41:06.748861 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:41:06.750525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:41:06.750525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:06.750525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:06.750525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:06.750525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:06.750525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:41:06.750525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:41:06.750525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:41:06.750525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:06.750525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:41:06.750525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:41:06.750525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': '6bb83365-2340-4ffa-b755-a7cce647c923'} Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:41:06.751491 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:41:06.752809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.754205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dca8311a-7960-4694-a3a1-5b0b7c3be9c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 404 to user: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:41:06.754205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dca8311a-7960-4694-a3a1-5b0b7c3be9c3 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 404 len: 111 microversion: 2.1 time: 0.029394 Jun 29 11:41:06.754205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 569/1136] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:41:06 2022] DELETE /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:41:06.759295 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5862e466-4861-4e31-9bb8-75aadb320a47 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:06.759937 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5862e466-4861-4e31-9bb8-75aadb320a47 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: 6bb83365-2340-4ffa-b755-a7cce647c923] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:06.765854 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5862e466-4861-4e31-9bb8-75aadb320a47 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:06.769604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5862e466-4861-4e31-9bb8-75aadb320a47 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:06.769604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5862e466-4861-4e31-9bb8-75aadb320a47 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:06.769604 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5862e466-4861-4e31-9bb8-75aadb320a47 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:06.781556 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-5862e466-4861-4e31-9bb8-75aadb320a47 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5862e466-4861-4e31-9bb8-75aadb320a47 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 HTTP/1.1 Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:41:06.783085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:41:06.785415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:41:06.785415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:06.785415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:06.785415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:06.785415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:06.785415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:41:06.785415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:41:06.785415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:41:06.785415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:06.785415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:41:06.785415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:41:06.785415 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': '6bb83365-2340-4ffa-b755-a7cce647c923'} Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:41:06.789851 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. Jun 29 11:41:06.791429 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:06.792960 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5862e466-4861-4e31-9bb8-75aadb320a47 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 404 to user: Instance 6bb83365-2340-4ffa-b755-a7cce647c923 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:41:06.792960 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5862e466-4861-4e31-9bb8-75aadb320a47 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923" status: 404 len: 111 microversion: 2.1 time: 0.028970 Jun 29 11:41:06.792960 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 568/1137] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:06 2022] GET /compute/v2.1/servers/6bb83365-2340-4ffa-b755-a7cce647c923 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:41:08.083001 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f12a0ba3-cdfd-412c-8e1d-2c5dc3548ce7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:08.083503 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f12a0ba3-cdfd-412c-8e1d-2c5dc3548ce7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:08.090215 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f12a0ba3-cdfd-412c-8e1d-2c5dc3548ce7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:08.090668 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f12a0ba3-cdfd-412c-8e1d-2c5dc3548ce7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:08.091444 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f12a0ba3-cdfd-412c-8e1d-2c5dc3548ce7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:08.091904 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f12a0ba3-cdfd-412c-8e1d-2c5dc3548ce7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:08.106223 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-f12a0ba3-cdfd-412c-8e1d-2c5dc3548ce7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f12a0ba3-cdfd-412c-8e1d-2c5dc3548ce7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 HTTP/1.1 Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept: application/json Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Connection: close Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Host: 10.222.0.44 Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.9 Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Role: member,reader Jun 29 11:41:08.107781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Roles: member,reader Jun 29 11:41:08.109474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:41:08.109474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:08.109474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:08.109474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:08.109474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:08.109474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jun 29 11:41:08.109474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jun 29 11:41:08.109474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:41:08.109474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:08.109474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: method: > Jun 29 11:41:08.109474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: exception: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:41:08.109474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: action_args: {'id': 'e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858'} Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:41:08.110392 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:41:08.111990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jun 29 11:41:08.114410 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f12a0ba3-cdfd-412c-8e1d-2c5dc3548ce7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 404 to user: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:41:08.114410 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f12a0ba3-cdfd-412c-8e1d-2c5dc3548ce7 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 404 len: 111 microversion: 2.1 time: 0.030200 Jun 29 11:41:08.114410 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 570/1138] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:41:08 2022] DELETE /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 11:41:08.118749 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e1fef1a3-cce8-4053-a0c7-1ddf543d8014 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:08.119346 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e1fef1a3-cce8-4053-a0c7-1ddf543d8014 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] [instance: e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:08.125677 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1fef1a3-cce8-4053-a0c7-1ddf543d8014 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:08.126114 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1fef1a3-cce8-4053-a0c7-1ddf543d8014 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:08.126867 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1fef1a3-cce8-4053-a0c7-1ddf543d8014 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:08.127291 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1fef1a3-cce8-4053-a0c7-1ddf543d8014 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:08.140503 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-e1fef1a3-cce8-4053-a0c7-1ddf543d8014 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] HTTP exception thrown: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e1fef1a3-cce8-4053-a0c7-1ddf543d8014 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Request method failure captured: Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 HTTP/1.1 Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDg7MZ_Ym21wP8Xq_Al_pRGquEL4wV7Epg17KiT2c__Q4rkG-AwxgGOFGkl9FA3t1kbOpaw8Y8pboFbEo_YMChtU-NO466lDcW4f7N-5BSzvrV3lSdsKtBgN83-9E4FUQ3-ao6K8kDVV93EnyiUnhU7R3qEuouGhNUFgQNfJAmajWYk Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:41:08.142009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:41:08.143667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7e39c9a1ff3c46dcbe4464f57534e5ea", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7e39c9a1ff3c46dcbe4464f57534e5ea"}]}] Jun 29 11:41:08.143667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:08.143667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 7e39c9a1ff3c46dcbe4464f57534e5ea Jun 29 11:41:08.143667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-944464173 Jun 29 11:41:08.143667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:08.143667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:41:08.143667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:41:08.143667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: cf7bc4681c954c158a7051046bd9aa47 Jun 29 11:41:08.143667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-944464173-project Jun 29 11:41:08.143667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:41:08.143667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:41:08.143667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': 'e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858'} Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:41:08.144632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. Jun 29 11:41:08.146217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:41:08.147617 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e1fef1a3-cce8-4053-a0c7-1ddf543d8014 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] Returning 404 to user: Instance e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:41:08.147617 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e1fef1a3-cce8-4053-a0c7-1ddf543d8014 tempest-AttachVolumeNegativeTest-944464173 tempest-AttachVolumeNegativeTest-944464173-project] 10.222.0.44 "GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858" status: 404 len: 111 microversion: 2.1 time: 0.028436 Jun 29 11:41:08.147617 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 569/1139] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:08 2022] GET /compute/v2.1/servers/e3ac7f00-cd9d-4929-ac2f-4e8bf85c6858 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:41:16.783054 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-388071e1-36c6-4c4b-a6e4-fd05309588a5 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] Calling method '.version_select at 0x7fd0894a5550>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:16.856527 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-388071e1-36c6-4c4b-a6e4-fd05309588a5 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/701d0dce-1c0a-466a-832d-77a2fb33281f" status: 200 len: 351 microversion: 2.1 time: 0.077922 Jun 29 11:41:16.857297 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 571/1140] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:41:16 2022] GET /compute/v2.1/os-volumes/701d0dce-1c0a-466a-832d-77a2fb33281f => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:41:19.701060 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f8b2da3d-2ca7-4d6a-b70a-70bf0d63b81e tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] Calling method '.version_select at 0x7fd0894de1f0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:19.708699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:41:19.709440 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=40 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:41:19.754009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f8b2da3d-2ca7-4d6a-b70a-70bf0d63b81e tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/273fc6da-37a6-4884-ad8d-a74020dc50db" status: 200 len: 351 microversion: 2.1 time: 0.056802 Jun 29 11:41:19.754766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 570/1141] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:41:19 2022] GET /compute/v2.1/os-volumes/273fc6da-37a6-4884-ad8d-a74020dc50db => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:41:20.601046 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:41:20.604630 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:41:20.823072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-be5f6719-c13f-4401-a0ed-3887297aa5ae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Action: 'create', calling method: .version_select at 0x7fd08937df70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1576827291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5/TZ/tGUwzV4InXr39B/nO5VUmLPEVAsGWAdFR9WLBJZ7v0krjADl1rBxHVQfNf7Q2E6fMTCUNVYG5bNT2fTrc2oiP2TauBi6S6V6ivOhoo23T9JQEZ02deU/Fi1n/g=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:41:20.839044 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-be5f6719-c13f-4401-a0ed-3887297aa5ae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Getting quotas for project 40d5bbf32cb54de2a37895f53bcb9d4a. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:41:20.842761 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-be5f6719-c13f-4401-a0ed-3887297aa5ae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Getting quotas for user f9db0a0b5bcf4e6d8ee2593b21c415fb and project 40d5bbf32cb54de2a37895f53bcb9d4a. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:41:20.952080 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-be5f6719-c13f-4401-a0ed-3887297aa5ae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.352112 Jun 29 11:41:20.952699 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 572/1142] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jun 29 11:41:20 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:41:21.434327 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4e8c208f-b877-4e95-bf4e-9c197c83a7f6 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] Calling method '.version_select at 0x7fd089620790>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:21.485151 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4e8c208f-b877-4e95-bf4e-9c197c83a7f6 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e0f59da5-8f63-483b-920a-186cb4b91f86" status: 200 len: 351 microversion: 2.1 time: 0.055113 Jun 29 11:41:21.485807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 571/1143] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jun 29 11:41:21 2022] GET /compute/v2.1/os-volumes/e0f59da5-8f63-483b-920a-186cb4b91f86 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:41:21.497479 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dd4dced7-8820-42d8-9255-4659ca18eae0 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] Calling method '.version_select at 0x7fd089821f70>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:21.582097 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dd4dced7-8820-42d8-9255-4659ca18eae0 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088393 Jun 29 11:41:21.582784 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 573/1144] 10.222.0.44 () {58 vars in 1133 bytes} [Wed Jun 29 11:41:21 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:21.594754 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df8a0264-7dce-4f6a-b53e-92d3806f8de4 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] Calling method '.version_select at 0x7fd089530820>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:21.687238 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-df8a0264-7dce-4f6a-b53e-92d3806f8de4 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.096365 Jun 29 11:41:21.687810 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 572/1145] 10.222.0.44 () {58 vars in 1148 bytes} [Wed Jun 29 11:41:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:41:21.700948 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e51cdbe3-4322-4220-b49d-1ee1185126f0 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] Calling method '.version_select at 0x7fd0895190d0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:21.789368 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e51cdbe3-4322-4220-b49d-1ee1185126f0 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.092685 Jun 29 11:41:21.789940 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 574/1146] 10.222.0.44 () {58 vars in 1133 bytes} [Wed Jun 29 11:41:21 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:21.801610 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9db58e2f-1a11-41fb-bd34-83ea602bac7e tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] Calling method '.version_select at 0x7fd0894de040>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:21.888932 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9db58e2f-1a11-41fb-bd34-83ea602bac7e tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091757 Jun 29 11:41:21.889648 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 573/1147] 10.222.0.44 () {58 vars in 1166 bytes} [Wed Jun 29 11:41:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:41:21.901447 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bf61012d-bbe6-406e-85fd-5590310ae261 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] Calling method '.version_select at 0x7fd08958fca0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:21.998916 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bf61012d-bbe6-406e-85fd-5590310ae261 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.101522 Jun 29 11:41:21.999654 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 575/1148] 10.222.0.44 () {58 vars in 1169 bytes} [Wed Jun 29 11:41:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:41:22.013106 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fce56e3e-b63d-4453-990c-1b74eedd7f13 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] Calling method '.version_select at 0x7fd089651af0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:22.094012 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fce56e3e-b63d-4453-990c-1b74eedd7f13 tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085161 Jun 29 11:41:22.094579 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 574/1149] 10.222.0.44 () {58 vars in 1154 bytes} [Wed Jun 29 11:41:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:41:22.106274 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ddd830ec-2a24-4c8d-8f9a-56eda571c4bf tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] Calling method '.version_select at 0x7fd08958f310>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:22.210139 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ddd830ec-2a24-4c8d-8f9a-56eda571c4bf tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099446 Jun 29 11:41:22.210139 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 576/1150] 10.222.0.44 () {58 vars in 1187 bytes} [Wed Jun 29 11:41:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:41:22.216123 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7ce3dab7-42d7-4eb4-93b6-98331ddaa32c tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] Calling method '.version_select at 0x7fd089530940>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:22.317230 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7ce3dab7-42d7-4eb4-93b6-98331ddaa32c tempest-VolumesTestJSON-999919877 tempest-VolumesTestJSON-999919877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.105603 Jun 29 11:41:22.319157 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 575/1151] 10.222.0.44 () {58 vars in 1154 bytes} [Wed Jun 29 11:41:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:45.579907 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:41:45.580692 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:41:45.584656 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-773442891", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1576827291", "security_groups": [{"name": "tempest-secgroup-smoke-1041815393"}], "networks": [{"uuid": "14ef3ee3-770f-423f-bbf7-730ed5c3f282"}], "block_device_mapping_v2": [{"uuid": "c794ad96-96d0-48b9-b749-e52f21e20094", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:41:45.697071 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] validate_networks() for [('14ef3ee3-770f-423f-bbf7-730ed5c3f282', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:41:46.071288 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:41:46.071707 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:41:46.072202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:41:46.072610 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:41:46.073015 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:41:46.082270 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:46.082716 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:46.083822 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:46.084072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:46.100830 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Getting quotas for project 40d5bbf32cb54de2a37895f53bcb9d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:41:46.104729 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Getting quotas for user f9db0a0b5bcf4e6d8ee2593b21c415fb and project 40d5bbf32cb54de2a37895f53bcb9d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:41:46.162431 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:41:46.164534 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c794ad96-96d0-48b9-b749-e52f21e20094',volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:41:46.730791 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-791524d0-92b0-417d-949c-e6a7a9a45c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.151971 Jun 29 11:41:46.731409 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 577/1152] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:41:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:41:46.742969 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5307cfd2-1355-44a5-a80b-b84676179664 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:46.743617 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5307cfd2-1355-44a5-a80b-b84676179664 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:46.797131 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5307cfd2-1355-44a5-a80b-b84676179664 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:46.804530 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5307cfd2-1355-44a5-a80b-b84676179664 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1088 microversion: 2.1 time: 0.066556 Jun 29 11:41:46.805531 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 576/1153] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:46 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:41:47.823387 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6369188f-8e2d-4268-b512-a891f7aaf7ce tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:47.824077 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6369188f-8e2d-4268-b512-a891f7aaf7ce tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:47.877925 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6369188f-8e2d-4268-b512-a891f7aaf7ce tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:47.886569 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6369188f-8e2d-4268-b512-a891f7aaf7ce tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1088 microversion: 2.1 time: 0.067483 Jun 29 11:41:47.887137 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 578/1154] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:47 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:48.903236 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0c18f9fa-d12a-496d-b779-aba4d5699557 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:48.903873 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0c18f9fa-d12a-496d-b779-aba4d5699557 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:48.911428 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c18f9fa-d12a-496d-b779-aba4d5699557 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:48.911912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c18f9fa-d12a-496d-b779-aba4d5699557 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:48.912684 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c18f9fa-d12a-496d-b779-aba4d5699557 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:48.913120 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c18f9fa-d12a-496d-b779-aba4d5699557 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:48.977689 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0c18f9fa-d12a-496d-b779-aba4d5699557 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:48.985228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0c18f9fa-d12a-496d-b779-aba4d5699557 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1130 microversion: 2.1 time: 0.085871 Jun 29 11:41:48.985790 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 577/1155] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:48 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1130 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:50.003097 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8dac6196-70ed-4211-ace1-6b5b4b523a36 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:50.014626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8dac6196-70ed-4211-ace1-6b5b4b523a36 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:50.014626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dac6196-70ed-4211-ace1-6b5b4b523a36 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:50.014626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dac6196-70ed-4211-ace1-6b5b4b523a36 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:50.014626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dac6196-70ed-4211-ace1-6b5b4b523a36 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:50.015053 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dac6196-70ed-4211-ace1-6b5b4b523a36 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:50.079530 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8dac6196-70ed-4211-ace1-6b5b4b523a36 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:50.088353 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8dac6196-70ed-4211-ace1-6b5b4b523a36 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1204 microversion: 2.1 time: 0.089642 Jun 29 11:41:50.089081 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 579/1156] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:49 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1204 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:51.108503 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-da4c48ac-d9f1-4608-b148-94551d5bdc42 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:51.109096 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-da4c48ac-d9f1-4608-b148-94551d5bdc42 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:51.115390 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da4c48ac-d9f1-4608-b148-94551d5bdc42 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:51.115858 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da4c48ac-d9f1-4608-b148-94551d5bdc42 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:51.116623 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da4c48ac-d9f1-4608-b148-94551d5bdc42 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:51.117081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da4c48ac-d9f1-4608-b148-94551d5bdc42 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:51.282308 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-da4c48ac-d9f1-4608-b148-94551d5bdc42 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:51.292401 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-da4c48ac-d9f1-4608-b148-94551d5bdc42 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1272 microversion: 2.1 time: 0.187675 Jun 29 11:41:51.293010 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 578/1157] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:51 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:51.889768 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-a764f929-97bd-4c99-877c-0145fffc91ca req-919a7a08-0609-4300-895d-47e2ee556e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7076be8a-f02b-49f2-9124-c2a539ac2cef", "tag": "4b70fef6-1e62-47b1-a889-8e64a22f1d6c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:41:51.899778 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a764f929-97bd-4c99-877c-0145fffc91ca req-919a7a08-0609-4300-895d-47e2ee556e03 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:51.900259 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-a764f929-97bd-4c99-877c-0145fffc91ca req-919a7a08-0609-4300-895d-47e2ee556e03 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:51.912203 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-a764f929-97bd-4c99-877c-0145fffc91ca req-919a7a08-0609-4300-895d-47e2ee556e03 service nova] Creating event network-changed:4b70fef6-1e62-47b1-a889-8e64a22f1d6c for instance 7076be8a-f02b-49f2-9124-c2a539ac2cef on hv-cinder-84733 Jun 29 11:41:51.918927 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-a764f929-97bd-4c99-877c-0145fffc91ca req-919a7a08-0609-4300-895d-47e2ee556e03 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180553 Jun 29 11:41:51.920055 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 580/1158] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:41:52.309815 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-91c0708a-693c-4719-a19b-c873fb0a2e14 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:52.310587 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-91c0708a-693c-4719-a19b-c873fb0a2e14 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:52.317183 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91c0708a-693c-4719-a19b-c873fb0a2e14 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:52.317870 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91c0708a-693c-4719-a19b-c873fb0a2e14 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:52.318392 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91c0708a-693c-4719-a19b-c873fb0a2e14 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:52.318827 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91c0708a-693c-4719-a19b-c873fb0a2e14 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:52.461438 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-91c0708a-693c-4719-a19b-c873fb0a2e14 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:52.472908 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-91c0708a-693c-4719-a19b-c873fb0a2e14 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1260 microversion: 2.1 time: 0.164486 Jun 29 11:41:52.472908 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 579/1159] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:52 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:53.487661 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23c9baeb-fdce-45d5-8c06-2e3823c2721f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:53.488663 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-23c9baeb-fdce-45d5-8c06-2e3823c2721f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:53.494890 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23c9baeb-fdce-45d5-8c06-2e3823c2721f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:53.495345 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23c9baeb-fdce-45d5-8c06-2e3823c2721f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:53.496169 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23c9baeb-fdce-45d5-8c06-2e3823c2721f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:53.496611 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23c9baeb-fdce-45d5-8c06-2e3823c2721f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:53.629819 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23c9baeb-fdce-45d5-8c06-2e3823c2721f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:53.638275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-23c9baeb-fdce-45d5-8c06-2e3823c2721f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1260 microversion: 2.1 time: 0.155001 Jun 29 11:41:53.638275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 581/1160] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:53 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:54.451026 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-945175808", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "networks": [{"uuid": "6fbeb3db-be77-4e47-90d4-7ea075cb707a"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:41:54.501080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] validate_networks() for [('6fbeb3db-be77-4e47-90d4-7ea075cb707a', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:41:54.654500 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-db91762c-c19f-42e6-9a14-30a2d36393f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:54.655126 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-db91762c-c19f-42e6-9a14-30a2d36393f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:54.663033 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db91762c-c19f-42e6-9a14-30a2d36393f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:54.663479 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db91762c-c19f-42e6-9a14-30a2d36393f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:54.664294 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db91762c-c19f-42e6-9a14-30a2d36393f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:54.666051 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db91762c-c19f-42e6-9a14-30a2d36393f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:54.962809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-db91762c-c19f-42e6-9a14-30a2d36393f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:54.970388 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-db91762c-c19f-42e6-9a14-30a2d36393f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1260 microversion: 2.1 time: 0.319736 Jun 29 11:41:54.970908 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 582/1161] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:54 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1260 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:41:55.026177 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:41:55.026602 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:41:55.027070 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:41:55.027475 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:41:55.027909 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:41:55.037299 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:55.037743 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:55.038532 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:55.038964 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:55.055116 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Getting quotas for project b0f099825879470bba2817a0d02c0e84. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:41:55.059009 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Getting quotas for user 6271b17d93a947beb71b5a42e70db55a and project b0f099825879470bba2817a0d02c0e84. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:41:55.069661 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:41:55.071880 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:41:55.187081 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1550e9f1-0a13-433b-9306-081921d32027 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739841 Jun 29 11:41:55.193279 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 580/1162] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:41:55.198414 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5f480a65-bd1e-4a16-986d-f5c05725bbf1 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:55.199029 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5f480a65-bd1e-4a16-986d-f5c05725bbf1 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:55.256282 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5f480a65-bd1e-4a16-986d-f5c05725bbf1 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:55.264638 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5f480a65-bd1e-4a16-986d-f5c05725bbf1 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1213 microversion: 2.1 time: 0.070046 Jun 29 11:41:55.265340 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 583/1163] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:55 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:55.989091 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9f70e587-84af-43bd-b7e3-6b95d1b23581 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:55.989741 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9f70e587-84af-43bd-b7e3-6b95d1b23581 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:55.995858 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f70e587-84af-43bd-b7e3-6b95d1b23581 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:55.996323 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f70e587-84af-43bd-b7e3-6b95d1b23581 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:55.997082 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f70e587-84af-43bd-b7e3-6b95d1b23581 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:55.997513 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f70e587-84af-43bd-b7e3-6b95d1b23581 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:56.130318 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9f70e587-84af-43bd-b7e3-6b95d1b23581 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:56.137750 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9f70e587-84af-43bd-b7e3-6b95d1b23581 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1260 microversion: 2.1 time: 0.153960 Jun 29 11:41:56.138310 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 581/1164] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:55 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:56.282048 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5e21fef8-9254-4cd8-b9cd-ee33d6469ff9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:56.282689 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5e21fef8-9254-4cd8-b9cd-ee33d6469ff9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:56.285724 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:41:56.339051 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e21fef8-9254-4cd8-b9cd-ee33d6469ff9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:56.345665 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5e21fef8-9254-4cd8-b9cd-ee33d6469ff9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1213 microversion: 2.1 time: 0.067455 Jun 29 11:41:56.346790 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 584/1165] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:56 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:57.153516 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-13ace97c-b11d-42a8-9bff-12236a85295e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:57.157655 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-13ace97c-b11d-42a8-9bff-12236a85295e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:57.160941 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13ace97c-b11d-42a8-9bff-12236a85295e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:57.161392 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13ace97c-b11d-42a8-9bff-12236a85295e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:57.162151 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13ace97c-b11d-42a8-9bff-12236a85295e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:57.162586 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13ace97c-b11d-42a8-9bff-12236a85295e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:57.290024 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-13ace97c-b11d-42a8-9bff-12236a85295e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:57.297502 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-13ace97c-b11d-42a8-9bff-12236a85295e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1260 microversion: 2.1 time: 0.147842 Jun 29 11:41:57.298106 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 582/1166] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:57 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:57.363464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5013891e-2e50-45f6-aed2-5a21f950ac66 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:57.364130 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5013891e-2e50-45f6-aed2-5a21f950ac66 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:57.371433 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5013891e-2e50-45f6-aed2-5a21f950ac66 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:57.371908 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5013891e-2e50-45f6-aed2-5a21f950ac66 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:57.372671 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5013891e-2e50-45f6-aed2-5a21f950ac66 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:57.373100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5013891e-2e50-45f6-aed2-5a21f950ac66 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:57.435353 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5013891e-2e50-45f6-aed2-5a21f950ac66 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:57.443283 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5013891e-2e50-45f6-aed2-5a21f950ac66 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1265 microversion: 2.1 time: 0.084759 Jun 29 11:41:57.444060 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 585/1167] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:57 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:58.314518 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0b48bf62-6de4-4260-9a55-e3a4b4e29e07 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:58.320720 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0b48bf62-6de4-4260-9a55-e3a4b4e29e07 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:58.321829 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b48bf62-6de4-4260-9a55-e3a4b4e29e07 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:58.322285 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b48bf62-6de4-4260-9a55-e3a4b4e29e07 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:58.323059 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b48bf62-6de4-4260-9a55-e3a4b4e29e07 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:58.323497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b48bf62-6de4-4260-9a55-e3a4b4e29e07 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:58.460149 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8aedb808-fc9f-41ef-bef5-802837bdf31f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:58.462857 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8aedb808-fc9f-41ef-bef5-802837bdf31f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:58.467347 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8aedb808-fc9f-41ef-bef5-802837bdf31f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:58.467916 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8aedb808-fc9f-41ef-bef5-802837bdf31f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:58.468678 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8aedb808-fc9f-41ef-bef5-802837bdf31f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:58.469106 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8aedb808-fc9f-41ef-bef5-802837bdf31f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:58.485178 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0b48bf62-6de4-4260-9a55-e3a4b4e29e07 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:58.493641 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0b48bf62-6de4-4260-9a55-e3a4b4e29e07 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1260 microversion: 2.1 time: 0.182924 Jun 29 11:41:58.494515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 583/1168] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:58 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:41:58.704749 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8aedb808-fc9f-41ef-bef5-802837bdf31f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:41:58.712751 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8aedb808-fc9f-41ef-bef5-802837bdf31f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1313 microversion: 2.1 time: 0.256609 Jun 29 11:41:58.713317 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 586/1169] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:58 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:41:59.356372 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-45dd632a-3fbe-48bd-a104-8040814eac8a req-cf06ea4f-8b0f-4074-9d67-daaa7d73f910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854c5cb3-dd66-4dc6-900a-3ec5aaed5a41", "tag": "8d68d31f-b983-48eb-9eed-25264f460fd8"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:41:59.370902 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-45dd632a-3fbe-48bd-a104-8040814eac8a req-cf06ea4f-8b0f-4074-9d67-daaa7d73f910 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:59.370902 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-45dd632a-3fbe-48bd-a104-8040814eac8a req-cf06ea4f-8b0f-4074-9d67-daaa7d73f910 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:59.377731 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-45dd632a-3fbe-48bd-a104-8040814eac8a req-cf06ea4f-8b0f-4074-9d67-daaa7d73f910 service nova] Creating event network-changed:8d68d31f-b983-48eb-9eed-25264f460fd8 for instance 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 on hv-cinder-84733 Jun 29 11:41:59.383075 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-45dd632a-3fbe-48bd-a104-8040814eac8a req-cf06ea4f-8b0f-4074-9d67-daaa7d73f910 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030399 Jun 29 11:41:59.383675 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 584/1170] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:41:59.511641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-93dc4797-5291-4f16-b6b9-281f36a680e3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:59.513595 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-93dc4797-5291-4f16-b6b9-281f36a680e3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:59.520901 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93dc4797-5291-4f16-b6b9-281f36a680e3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:59.521466 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93dc4797-5291-4f16-b6b9-281f36a680e3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:59.522252 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93dc4797-5291-4f16-b6b9-281f36a680e3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:59.522818 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93dc4797-5291-4f16-b6b9-281f36a680e3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:59.661133 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-7e36d9f1-ba8f-448e-a89a-839367f3b7eb req-16f2e3eb-ec0f-489a-9170-e8d76088f3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7076be8a-f02b-49f2-9124-c2a539ac2cef", "name": "network-vif-plugged", "status": "completed", "tag": "4b70fef6-1e62-47b1-a889-8e64a22f1d6c"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:41:59.669847 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7e36d9f1-ba8f-448e-a89a-839367f3b7eb req-16f2e3eb-ec0f-489a-9170-e8d76088f3b1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:59.670287 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7e36d9f1-ba8f-448e-a89a-839367f3b7eb req-16f2e3eb-ec0f-489a-9170-e8d76088f3b1 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:59.682137 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-7e36d9f1-ba8f-448e-a89a-839367f3b7eb req-16f2e3eb-ec0f-489a-9170-e8d76088f3b1 service nova] Creating event network-vif-plugged:4b70fef6-1e62-47b1-a889-8e64a22f1d6c for instance 7076be8a-f02b-49f2-9124-c2a539ac2cef on hv-cinder-84733 Jun 29 11:41:59.687217 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-7e36d9f1-ba8f-448e-a89a-839367f3b7eb req-16f2e3eb-ec0f-489a-9170-e8d76088f3b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095324 Jun 29 11:41:59.687823 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 585/1171] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:41:59.733671 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2dabe9b6-b480-4aa6-b060-57452f14fb3b tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:41:59.735577 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2dabe9b6-b480-4aa6-b060-57452f14fb3b tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:41:59.751145 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2dabe9b6-b480-4aa6-b060-57452f14fb3b tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:59.754113 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2dabe9b6-b480-4aa6-b060-57452f14fb3b tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:41:59.754113 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2dabe9b6-b480-4aa6-b060-57452f14fb3b tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:41:59.754573 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2dabe9b6-b480-4aa6-b060-57452f14fb3b tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:00.055593 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-93dc4797-5291-4f16-b6b9-281f36a680e3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:00.063635 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-93dc4797-5291-4f16-b6b9-281f36a680e3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1260 microversion: 2.1 time: 0.556951 Jun 29 11:42:00.064634 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 587/1172] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:59 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1260 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:42:00.083468 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2dabe9b6-b480-4aa6-b060-57452f14fb3b tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:00.092035 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2dabe9b6-b480-4aa6-b060-57452f14fb3b tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1313 microversion: 2.1 time: 0.363253 Jun 29 11:42:00.092035 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 586/1173] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:41:59 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:01.081303 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f1bed98d-bd16-41ad-aeec-21621e02a6f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:01.082018 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f1bed98d-bd16-41ad-aeec-21621e02a6f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:01.088307 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1bed98d-bd16-41ad-aeec-21621e02a6f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:01.088756 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1bed98d-bd16-41ad-aeec-21621e02a6f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:01.089508 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1bed98d-bd16-41ad-aeec-21621e02a6f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:01.089934 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1bed98d-bd16-41ad-aeec-21621e02a6f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:01.106469 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a47b3d4e-a15a-49b7-b370-1892ed7cfcd8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:01.107140 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a47b3d4e-a15a-49b7-b370-1892ed7cfcd8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:01.114540 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a47b3d4e-a15a-49b7-b370-1892ed7cfcd8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:01.115234 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a47b3d4e-a15a-49b7-b370-1892ed7cfcd8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:01.116080 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a47b3d4e-a15a-49b7-b370-1892ed7cfcd8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:01.116610 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a47b3d4e-a15a-49b7-b370-1892ed7cfcd8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:01.344011 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f1bed98d-bd16-41ad-aeec-21621e02a6f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:01.351780 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f1bed98d-bd16-41ad-aeec-21621e02a6f2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1260 microversion: 2.1 time: 0.274302 Jun 29 11:42:01.352580 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 588/1174] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:01 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:01.358537 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a47b3d4e-a15a-49b7-b370-1892ed7cfcd8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:01.366858 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a47b3d4e-a15a-49b7-b370-1892ed7cfcd8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1313 microversion: 2.1 time: 0.264333 Jun 29 11:42:01.367413 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 587/1175] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:01 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:42:02.369229 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b02e6f95-b963-49f2-8885-210f887c4c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:02.369872 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b02e6f95-b963-49f2-8885-210f887c4c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:02.376893 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b02e6f95-b963-49f2-8885-210f887c4c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:02.377329 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b02e6f95-b963-49f2-8885-210f887c4c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:02.378756 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b02e6f95-b963-49f2-8885-210f887c4c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:02.379390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b02e6f95-b963-49f2-8885-210f887c4c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:02.385614 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bc720618-a8e1-4af6-acd0-03421748cecf tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:02.386345 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bc720618-a8e1-4af6-acd0-03421748cecf tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:02.394684 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bc720618-a8e1-4af6-acd0-03421748cecf tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:02.395134 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bc720618-a8e1-4af6-acd0-03421748cecf tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:02.395970 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bc720618-a8e1-4af6-acd0-03421748cecf tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:02.396409 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bc720618-a8e1-4af6-acd0-03421748cecf tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:02.581222 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b02e6f95-b963-49f2-8885-210f887c4c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:02.584352 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bc720618-a8e1-4af6-acd0-03421748cecf tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:02.588882 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b02e6f95-b963-49f2-8885-210f887c4c4a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1443 microversion: 2.1 time: 0.223443 Jun 29 11:42:02.589460 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 589/1176] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:02 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1443 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:02.591938 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bc720618-a8e1-4af6-acd0-03421748cecf tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1313 microversion: 2.1 time: 0.211658 Jun 29 11:42:02.592498 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 588/1177] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:02 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:42:02.604930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4804b3a8-b2ae-47b0-9b78-cf61c11c49aa tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:02.605561 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4804b3a8-b2ae-47b0-9b78-cf61c11c49aa tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:02.611471 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4804b3a8-b2ae-47b0-9b78-cf61c11c49aa tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:02.611948 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4804b3a8-b2ae-47b0-9b78-cf61c11c49aa tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:02.613595 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4804b3a8-b2ae-47b0-9b78-cf61c11c49aa tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:02.614025 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4804b3a8-b2ae-47b0-9b78-cf61c11c49aa tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:02.740284 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4804b3a8-b2ae-47b0-9b78-cf61c11c49aa tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:02.747646 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4804b3a8-b2ae-47b0-9b78-cf61c11c49aa tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1443 microversion: 2.1 time: 0.146497 Jun 29 11:42:02.748232 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 590/1178] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:02 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1443 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:42:03.609005 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b36a741c-272d-42f5-961e-e27938a80d08 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:03.609549 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b36a741c-272d-42f5-961e-e27938a80d08 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:03.616208 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b36a741c-272d-42f5-961e-e27938a80d08 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:03.616659 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b36a741c-272d-42f5-961e-e27938a80d08 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:03.617421 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b36a741c-272d-42f5-961e-e27938a80d08 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:03.617852 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b36a741c-272d-42f5-961e-e27938a80d08 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:03.802231 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b36a741c-272d-42f5-961e-e27938a80d08 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:03.809746 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b36a741c-272d-42f5-961e-e27938a80d08 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1313 microversion: 2.1 time: 0.204701 Jun 29 11:42:03.810314 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 589/1179] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:03 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:04.826922 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cae66eef-baf1-4767-9193-95e4843c3e73 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:04.827539 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cae66eef-baf1-4767-9193-95e4843c3e73 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:04.834742 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cae66eef-baf1-4767-9193-95e4843c3e73 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:04.835205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cae66eef-baf1-4767-9193-95e4843c3e73 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:04.836004 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cae66eef-baf1-4767-9193-95e4843c3e73 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:04.836612 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cae66eef-baf1-4767-9193-95e4843c3e73 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:04.843407 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-d5a1b891-2955-428a-84c0-78dd1c36720e req-038abe93-ae74-4814-b587-0ab00bad8a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7076be8a-f02b-49f2-9124-c2a539ac2cef", "tag": "4b70fef6-1e62-47b1-a889-8e64a22f1d6c"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:42:04.853280 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-d5a1b891-2955-428a-84c0-78dd1c36720e req-038abe93-ae74-4814-b587-0ab00bad8a35 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:04.854011 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-d5a1b891-2955-428a-84c0-78dd1c36720e req-038abe93-ae74-4814-b587-0ab00bad8a35 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:04.866248 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-d5a1b891-2955-428a-84c0-78dd1c36720e req-038abe93-ae74-4814-b587-0ab00bad8a35 service nova] Creating event network-changed:4b70fef6-1e62-47b1-a889-8e64a22f1d6c for instance 7076be8a-f02b-49f2-9124-c2a539ac2cef on hv-cinder-84733 Jun 29 11:42:04.872595 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-d5a1b891-2955-428a-84c0-78dd1c36720e req-038abe93-ae74-4814-b587-0ab00bad8a35 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033385 Jun 29 11:42:04.873296 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 590/1180] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:42:05.030006 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cae66eef-baf1-4767-9193-95e4843c3e73 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:05.038075 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cae66eef-baf1-4767-9193-95e4843c3e73 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1313 microversion: 2.1 time: 0.215259 Jun 29 11:42:05.038849 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 591/1181] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:04 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:06.051650 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:42:06.052490 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=8 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:42:06.057107 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5b771fb6-112a-404d-b8ce-edefcff49b61 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:06.057702 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5b771fb6-112a-404d-b8ce-edefcff49b61 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:06.063672 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b771fb6-112a-404d-b8ce-edefcff49b61 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:06.064146 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b771fb6-112a-404d-b8ce-edefcff49b61 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:06.064898 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b771fb6-112a-404d-b8ce-edefcff49b61 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:06.065329 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b771fb6-112a-404d-b8ce-edefcff49b61 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:06.192394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5b771fb6-112a-404d-b8ce-edefcff49b61 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:06.199735 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5b771fb6-112a-404d-b8ce-edefcff49b61 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1313 microversion: 2.1 time: 0.148977 Jun 29 11:42:06.200333 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 591/1182] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:06 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:07.216917 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8395a83a-fcca-4591-9e62-63bce532fe46 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:07.217527 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8395a83a-fcca-4591-9e62-63bce532fe46 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:07.219809 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=12 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:42:07.224611 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8395a83a-fcca-4591-9e62-63bce532fe46 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:07.225057 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8395a83a-fcca-4591-9e62-63bce532fe46 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:07.225815 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8395a83a-fcca-4591-9e62-63bce532fe46 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:07.226247 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8395a83a-fcca-4591-9e62-63bce532fe46 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:07.354016 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8395a83a-fcca-4591-9e62-63bce532fe46 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:07.361379 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8395a83a-fcca-4591-9e62-63bce532fe46 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1313 microversion: 2.1 time: 0.148293 Jun 29 11:42:07.361939 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 592/1183] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:07 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:07.547386 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-7cecca21-7238-48f3-9ebd-c43b290a7d7a req-29a0743b-5767-43d5-9db5-4df25e6378ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854c5cb3-dd66-4dc6-900a-3ec5aaed5a41", "name": "network-vif-plugged", "status": "completed", "tag": "8d68d31f-b983-48eb-9eed-25264f460fd8"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:42:07.556598 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7cecca21-7238-48f3-9ebd-c43b290a7d7a req-29a0743b-5767-43d5-9db5-4df25e6378ce service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:07.557036 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7cecca21-7238-48f3-9ebd-c43b290a7d7a req-29a0743b-5767-43d5-9db5-4df25e6378ce service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:07.568800 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-7cecca21-7238-48f3-9ebd-c43b290a7d7a req-29a0743b-5767-43d5-9db5-4df25e6378ce service nova] Creating event network-vif-plugged:8d68d31f-b983-48eb-9eed-25264f460fd8 for instance 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 on hv-cinder-84733 Jun 29 11:42:07.573758 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-7cecca21-7238-48f3-9ebd-c43b290a7d7a req-29a0743b-5767-43d5-9db5-4df25e6378ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030367 Jun 29 11:42:07.574404 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 592/1184] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:42:08.378437 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-abde9cea-faa4-417a-b8b6-521aa3f1f475 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:08.379076 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-abde9cea-faa4-417a-b8b6-521aa3f1f475 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:08.385518 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abde9cea-faa4-417a-b8b6-521aa3f1f475 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:08.385961 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abde9cea-faa4-417a-b8b6-521aa3f1f475 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:08.386706 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abde9cea-faa4-417a-b8b6-521aa3f1f475 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:08.387130 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-abde9cea-faa4-417a-b8b6-521aa3f1f475 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:08.520282 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-abde9cea-faa4-417a-b8b6-521aa3f1f475 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:08.528381 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-abde9cea-faa4-417a-b8b6-521aa3f1f475 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1313 microversion: 2.1 time: 0.153625 Jun 29 11:42:08.528998 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 593/1185] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:08 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:09.546613 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3695b57d-fe39-4424-8a98-971eb35d72d3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:09.547301 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3695b57d-fe39-4424-8a98-971eb35d72d3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:09.554428 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3695b57d-fe39-4424-8a98-971eb35d72d3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:09.554864 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3695b57d-fe39-4424-8a98-971eb35d72d3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:09.555616 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3695b57d-fe39-4424-8a98-971eb35d72d3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:09.556072 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3695b57d-fe39-4424-8a98-971eb35d72d3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:09.685893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3695b57d-fe39-4424-8a98-971eb35d72d3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:09.693328 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3695b57d-fe39-4424-8a98-971eb35d72d3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1496 microversion: 2.1 time: 0.151532 Jun 29 11:42:09.699014 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 593/1186] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:09 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1496 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:10.663156 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-64651943-8bd5-474b-bb78-1a48a0a41eae tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:10.663698 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-64651943-8bd5-474b-bb78-1a48a0a41eae tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:10.670162 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64651943-8bd5-474b-bb78-1a48a0a41eae tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:10.670611 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64651943-8bd5-474b-bb78-1a48a0a41eae tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:10.671395 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64651943-8bd5-474b-bb78-1a48a0a41eae tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:10.671844 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64651943-8bd5-474b-bb78-1a48a0a41eae tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:10.695915 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-64651943-8bd5-474b-bb78-1a48a0a41eae tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:42:10.990819 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-64651943-8bd5-474b-bb78-1a48a0a41eae tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "DELETE /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 204 len: 0 microversion: 2.1 time: 0.331801 Jun 29 11:42:10.991413 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 594/1187] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:42:10 2022] DELETE /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:42:10.999486 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7291a7fc-51b1-4c14-ad42-ff186768e83a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:11.000146 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7291a7fc-51b1-4c14-ad42-ff186768e83a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:11.007541 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7291a7fc-51b1-4c14-ad42-ff186768e83a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:11.008013 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7291a7fc-51b1-4c14-ad42-ff186768e83a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:11.008766 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7291a7fc-51b1-4c14-ad42-ff186768e83a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:11.009194 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7291a7fc-51b1-4c14-ad42-ff186768e83a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:11.137850 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7291a7fc-51b1-4c14-ad42-ff186768e83a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:11.145272 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7291a7fc-51b1-4c14-ad42-ff186768e83a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1502 microversion: 2.1 time: 0.149629 Jun 29 11:42:11.145859 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 594/1188] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:10 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:12.162719 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e52cced8-f80e-4a46-84e3-2ca759f6b2c3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:12.163418 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e52cced8-f80e-4a46-84e3-2ca759f6b2c3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:12.169831 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e52cced8-f80e-4a46-84e3-2ca759f6b2c3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:12.170284 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e52cced8-f80e-4a46-84e3-2ca759f6b2c3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:12.171043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e52cced8-f80e-4a46-84e3-2ca759f6b2c3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:12.171472 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e52cced8-f80e-4a46-84e3-2ca759f6b2c3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:12.302755 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e52cced8-f80e-4a46-84e3-2ca759f6b2c3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:12.310187 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e52cced8-f80e-4a46-84e3-2ca759f6b2c3 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1502 microversion: 2.1 time: 0.151709 Jun 29 11:42:12.310763 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 595/1189] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:12 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:13.326804 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-99e87da3-e52d-4651-83b4-9bf62a5a9937 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:13.327414 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-99e87da3-e52d-4651-83b4-9bf62a5a9937 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:13.334422 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99e87da3-e52d-4651-83b4-9bf62a5a9937 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:13.334875 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99e87da3-e52d-4651-83b4-9bf62a5a9937 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:13.335638 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99e87da3-e52d-4651-83b4-9bf62a5a9937 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:13.336095 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99e87da3-e52d-4651-83b4-9bf62a5a9937 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:13.430478 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-99e87da3-e52d-4651-83b4-9bf62a5a9937 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:13.438497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-99e87da3-e52d-4651-83b4-9bf62a5a9937 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 200 len: 1460 microversion: 2.1 time: 0.115648 Jun 29 11:42:13.439226 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 595/1190] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:13 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 1460 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:13.442306 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-9ea6ec05-abeb-4741-8df3-60a766f61479 req-a7aecbb9-f1e4-4558-841f-4912e651e5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854c5cb3-dd66-4dc6-900a-3ec5aaed5a41", "name": "network-vif-deleted", "tag": "8d68d31f-b983-48eb-9eed-25264f460fd8"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:42:13.451297 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9ea6ec05-abeb-4741-8df3-60a766f61479 req-a7aecbb9-f1e4-4558-841f-4912e651e5fe service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:13.451745 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9ea6ec05-abeb-4741-8df3-60a766f61479 req-a7aecbb9-f1e4-4558-841f-4912e651e5fe service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:13.455641 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:42:13.463236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-9ea6ec05-abeb-4741-8df3-60a766f61479 req-a7aecbb9-f1e4-4558-841f-4912e651e5fe service nova] Creating event network-vif-deleted:8d68d31f-b983-48eb-9eed-25264f460fd8 for instance 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 on hv-cinder-84733 Jun 29 11:42:13.468147 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-9ea6ec05-abeb-4741-8df3-60a766f61479 req-a7aecbb9-f1e4-4558-841f-4912e651e5fe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030383 Jun 29 11:42:13.468723 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 596/1191] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:42:14.455359 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bd019a65-9a06-4447-8016-1c4d0bb0f4f2 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:14.456450 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bd019a65-9a06-4447-8016-1c4d0bb0f4f2 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:14.462842 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd019a65-9a06-4447-8016-1c4d0bb0f4f2 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:14.463285 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd019a65-9a06-4447-8016-1c4d0bb0f4f2 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:14.464076 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd019a65-9a06-4447-8016-1c4d0bb0f4f2 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:14.464513 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd019a65-9a06-4447-8016-1c4d0bb0f4f2 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:14.478231 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-bd019a65-9a06-4447-8016-1c4d0bb0f4f2 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] HTTP exception thrown: Instance 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 could not be found. Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bd019a65-9a06-4447-8016-1c4d0bb0f4f2 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Request method failure captured: Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 HTTP/1.1 Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDp_KcBPDZVo8SBVtCe5s7FiBiruXktFkmMydzuudBGCJ1ijm8oA7qEXsFvTU7jokCeMkcewmcdWN3TPol8WzP9gaQpVCIoru1_DMsysbfEU4JHwNEqbXHI2aq235VdCmNsOeIKGHfdQU_ukk-9o3japPlMCHekV4Nph5L3Ob6CQyMs Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: b0f099825879470bba2817a0d02c0e84 Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesActionsTest-1590178576 Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:42:14.479893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:42:14.481501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b0f099825879470bba2817a0d02c0e84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b0f099825879470bba2817a0d02c0e84", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0f099825879470bba2817a0d02c0e84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0f099825879470bba2817a0d02c0e84"}]}] Jun 29 11:42:14.481501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesActionsTest-1590178576 Jun 29 11:42:14.481501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: b0f099825879470bba2817a0d02c0e84 Jun 29 11:42:14.481501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesActionsTest-1590178576 Jun 29 11:42:14.481501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesActionsTest-1590178576-project Jun 29 11:42:14.481501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:42:14.481501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:42:14.481501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 6271b17d93a947beb71b5a42e70db55a Jun 29 11:42:14.481501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesActionsTest-1590178576-project Jun 29 11:42:14.481501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:42:14.481501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 could not be found. Jun 29 11:42:14.481501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': '854c5cb3-dd66-4dc6-900a-3ec5aaed5a41'} Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 could not be found. Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:42:14.482426 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 could not be found. Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 could not be found. Jun 29 11:42:14.484077 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:42:14.486197 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bd019a65-9a06-4447-8016-1c4d0bb0f4f2 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Returning 404 to user: Instance 854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:42:14.486197 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bd019a65-9a06-4447-8016-1c4d0bb0f4f2 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41" status: 404 len: 111 microversion: 2.1 time: 0.030007 Jun 29 11:42:14.486197 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 596/1192] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:14 2022] GET /compute/v2.1/servers/854c5cb3-dd66-4dc6-900a-3ec5aaed5a41 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:42:14.531022 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1329952343", "imageRef": "666c5b81-6bba-4cb5-9525-3ed573c91192", "flavorRef": "452", "networks": [{"uuid": "6fbeb3db-be77-4e47-90d4-7ea075cb707a"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:42:14.583985 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] validate_networks() for [('6fbeb3db-be77-4e47-90d4-7ea075cb707a', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 11:42:14.937251 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 11:42:14.937695 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 11:42:14.938171 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 11:42:14.938582 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 11:42:14.938994 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 11:42:14.951986 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:14.952438 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:14.957087 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:14.957087 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:14.970528 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Getting quotas for project b0f099825879470bba2817a0d02c0e84. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 11:42:14.974521 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Getting quotas for user 6271b17d93a947beb71b5a42e70db55a and project b0f099825879470bba2817a0d02c0e84. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 11:42:14.985187 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 11:42:14.993968 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666c5b81-6bba-4cb5-9525-3ed573c91192',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 11:42:15.145672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6560273c-4c03-4f54-bc9b-385103b50b5a tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619674 Jun 29 11:42:15.146443 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 597/1193] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jun 29 11:42:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 11:42:15.156406 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b6abc2ed-cbfb-4df9-be87-d44028222386 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:15.157107 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b6abc2ed-cbfb-4df9-be87-d44028222386 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:15.210899 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b6abc2ed-cbfb-4df9-be87-d44028222386 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:15.219094 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b6abc2ed-cbfb-4df9-be87-d44028222386 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1214 microversion: 2.1 time: 0.066162 Jun 29 11:42:15.219670 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 597/1194] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:15 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:16.236629 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f3801f67-8951-4541-a667-de3cae0b6903 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:16.237280 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f3801f67-8951-4541-a667-de3cae0b6903 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:16.239693 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:42:16.245371 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3801f67-8951-4541-a667-de3cae0b6903 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:16.245810 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3801f67-8951-4541-a667-de3cae0b6903 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:16.246558 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3801f67-8951-4541-a667-de3cae0b6903 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:16.246989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f3801f67-8951-4541-a667-de3cae0b6903 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:16.307345 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f3801f67-8951-4541-a667-de3cae0b6903 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:16.314620 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f3801f67-8951-4541-a667-de3cae0b6903 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1218 microversion: 2.1 time: 0.082473 Jun 29 11:42:16.315620 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 598/1195] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:16 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:17.331934 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8bd99df3-f1eb-4190-93b3-92dee6f1ba40 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:17.332667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8bd99df3-f1eb-4190-93b3-92dee6f1ba40 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:17.335241 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:42:17.340908 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bd99df3-f1eb-4190-93b3-92dee6f1ba40 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:17.341358 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bd99df3-f1eb-4190-93b3-92dee6f1ba40 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:17.342124 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bd99df3-f1eb-4190-93b3-92dee6f1ba40 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:17.342557 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bd99df3-f1eb-4190-93b3-92dee6f1ba40 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:17.346546 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=97 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:42:17.425912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8bd99df3-f1eb-4190-93b3-92dee6f1ba40 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:17.436560 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8bd99df3-f1eb-4190-93b3-92dee6f1ba40 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1274 microversion: 2.1 time: 0.108460 Jun 29 11:42:17.443818 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 598/1196] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:17 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:18.454217 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6bc7bcb1-386d-45e2-903d-1526018cf8e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:18.454834 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6bc7bcb1-386d-45e2-903d-1526018cf8e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:18.462421 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bc7bcb1-386d-45e2-903d-1526018cf8e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:18.462874 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bc7bcb1-386d-45e2-903d-1526018cf8e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:18.463639 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bc7bcb1-386d-45e2-903d-1526018cf8e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:18.464115 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bc7bcb1-386d-45e2-903d-1526018cf8e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:18.634620 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6bc7bcb1-386d-45e2-903d-1526018cf8e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:18.642143 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6bc7bcb1-386d-45e2-903d-1526018cf8e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1314 microversion: 2.1 time: 0.191795 Jun 29 11:42:18.642761 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 599/1197] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:18 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:42:18.885090 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-f9601452-17ce-4dd3-883b-79411ba940b1 req-5f120827-d570-48fb-803a-b1db646df10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3de0b6-a984-4965-a6c7-f221c37909c5", "tag": "de7542aa-d4a1-4f09-801f-c2b80f216477"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:42:18.894450 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f9601452-17ce-4dd3-883b-79411ba940b1 req-5f120827-d570-48fb-803a-b1db646df10b service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:18.894892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f9601452-17ce-4dd3-883b-79411ba940b1 req-5f120827-d570-48fb-803a-b1db646df10b service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:18.906238 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-f9601452-17ce-4dd3-883b-79411ba940b1 req-5f120827-d570-48fb-803a-b1db646df10b service nova] Creating event network-changed:de7542aa-d4a1-4f09-801f-c2b80f216477 for instance 7a3de0b6-a984-4965-a6c7-f221c37909c5 on hv-cinder-84733 Jun 29 11:42:18.912436 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-f9601452-17ce-4dd3-883b-79411ba940b1 req-5f120827-d570-48fb-803a-b1db646df10b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031429 Jun 29 11:42:18.913096 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 599/1198] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:42:19.660338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5f8eb3e2-e5b0-4913-9ad3-6099560f69e9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:19.660960 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5f8eb3e2-e5b0-4913-9ad3-6099560f69e9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:19.667268 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f8eb3e2-e5b0-4913-9ad3-6099560f69e9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:19.667721 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f8eb3e2-e5b0-4913-9ad3-6099560f69e9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:19.672236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f8eb3e2-e5b0-4913-9ad3-6099560f69e9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:19.672236 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f8eb3e2-e5b0-4913-9ad3-6099560f69e9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:19.797698 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5f8eb3e2-e5b0-4913-9ad3-6099560f69e9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:19.805046 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5f8eb3e2-e5b0-4913-9ad3-6099560f69e9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1314 microversion: 2.1 time: 0.149225 Jun 29 11:42:19.805603 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 600/1199] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:19 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:20.823268 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-13db6483-9e73-44bf-9c6f-f2179566a6d7 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:20.823996 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-13db6483-9e73-44bf-9c6f-f2179566a6d7 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:20.830176 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13db6483-9e73-44bf-9c6f-f2179566a6d7 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:20.831541 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13db6483-9e73-44bf-9c6f-f2179566a6d7 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:20.832070 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13db6483-9e73-44bf-9c6f-f2179566a6d7 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:20.832505 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13db6483-9e73-44bf-9c6f-f2179566a6d7 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:20.963342 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-13db6483-9e73-44bf-9c6f-f2179566a6d7 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:20.970794 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-13db6483-9e73-44bf-9c6f-f2179566a6d7 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1314 microversion: 2.1 time: 0.152345 Jun 29 11:42:20.971358 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 600/1200] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:20 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:21.987259 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e182936d-a5ff-4718-a543-189320d93561 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:21.987923 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e182936d-a5ff-4718-a543-189320d93561 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:21.994549 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e182936d-a5ff-4718-a543-189320d93561 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:21.994990 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e182936d-a5ff-4718-a543-189320d93561 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:21.995739 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e182936d-a5ff-4718-a543-189320d93561 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:21.996190 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e182936d-a5ff-4718-a543-189320d93561 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:22.120404 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e182936d-a5ff-4718-a543-189320d93561 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:22.128135 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e182936d-a5ff-4718-a543-189320d93561 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1314 microversion: 2.1 time: 0.144151 Jun 29 11:42:22.128706 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 601/1201] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:21 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:23.144712 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cf0a26df-8b86-4eec-9b85-21ebd4ecfc28 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:23.145325 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cf0a26df-8b86-4eec-9b85-21ebd4ecfc28 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:23.151811 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cf0a26df-8b86-4eec-9b85-21ebd4ecfc28 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:23.152290 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cf0a26df-8b86-4eec-9b85-21ebd4ecfc28 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:23.153052 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cf0a26df-8b86-4eec-9b85-21ebd4ecfc28 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:23.153491 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cf0a26df-8b86-4eec-9b85-21ebd4ecfc28 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:23.293511 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cf0a26df-8b86-4eec-9b85-21ebd4ecfc28 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:23.300922 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cf0a26df-8b86-4eec-9b85-21ebd4ecfc28 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1314 microversion: 2.1 time: 0.160167 Jun 29 11:42:23.301502 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 601/1202] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:23 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:24.317331 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a923aaa2-09a8-40f4-8ce8-3e31cb189674 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:24.317935 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a923aaa2-09a8-40f4-8ce8-3e31cb189674 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:24.323811 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a923aaa2-09a8-40f4-8ce8-3e31cb189674 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:24.324287 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a923aaa2-09a8-40f4-8ce8-3e31cb189674 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:24.325048 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a923aaa2-09a8-40f4-8ce8-3e31cb189674 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:24.325479 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a923aaa2-09a8-40f4-8ce8-3e31cb189674 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:24.449525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a923aaa2-09a8-40f4-8ce8-3e31cb189674 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:24.456975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a923aaa2-09a8-40f4-8ce8-3e31cb189674 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1314 microversion: 2.1 time: 0.144266 Jun 29 11:42:24.457537 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 602/1203] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:24 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:25.473127 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-037e03dc-e1eb-45f9-ad7a-df5caf1d81d8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:25.473887 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-037e03dc-e1eb-45f9-ad7a-df5caf1d81d8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:25.476387 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:42:25.481446 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-037e03dc-e1eb-45f9-ad7a-df5caf1d81d8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:25.481892 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-037e03dc-e1eb-45f9-ad7a-df5caf1d81d8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:25.482662 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-037e03dc-e1eb-45f9-ad7a-df5caf1d81d8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:25.483098 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-037e03dc-e1eb-45f9-ad7a-df5caf1d81d8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:25.621629 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-037e03dc-e1eb-45f9-ad7a-df5caf1d81d8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:25.629644 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-037e03dc-e1eb-45f9-ad7a-df5caf1d81d8 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1314 microversion: 2.1 time: 0.160444 Jun 29 11:42:25.630206 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 602/1204] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:25 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:25.685058 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-8a4cbf3d-c589-4d46-b528-edd57c444736 req-42d57fb7-62bc-4330-ae70-ccf81770823c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3de0b6-a984-4965-a6c7-f221c37909c5", "name": "network-vif-plugged", "status": "completed", "tag": "de7542aa-d4a1-4f09-801f-c2b80f216477"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:42:25.688637 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:42:25.689372 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:42:25.695569 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8a4cbf3d-c589-4d46-b528-edd57c444736 req-42d57fb7-62bc-4330-ae70-ccf81770823c service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:25.696063 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8a4cbf3d-c589-4d46-b528-edd57c444736 req-42d57fb7-62bc-4330-ae70-ccf81770823c service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:25.706938 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-8a4cbf3d-c589-4d46-b528-edd57c444736 req-42d57fb7-62bc-4330-ae70-ccf81770823c service nova] Creating event network-vif-plugged:de7542aa-d4a1-4f09-801f-c2b80f216477 for instance 7a3de0b6-a984-4965-a6c7-f221c37909c5 on hv-cinder-84733 Jun 29 11:42:25.711976 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-8a4cbf3d-c589-4d46-b528-edd57c444736 req-42d57fb7-62bc-4330-ae70-ccf81770823c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030624 Jun 29 11:42:25.712578 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 603/1205] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:42:26.647146 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a826b380-b431-4444-88fa-3686d814fe17 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:26.647781 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a826b380-b431-4444-88fa-3686d814fe17 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:26.654224 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a826b380-b431-4444-88fa-3686d814fe17 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:26.654672 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a826b380-b431-4444-88fa-3686d814fe17 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:26.655422 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a826b380-b431-4444-88fa-3686d814fe17 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:26.655872 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a826b380-b431-4444-88fa-3686d814fe17 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:26.785258 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a826b380-b431-4444-88fa-3686d814fe17 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:26.792752 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a826b380-b431-4444-88fa-3686d814fe17 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1314 microversion: 2.1 time: 0.150142 Jun 29 11:42:26.799228 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 603/1206] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:26 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:27.811002 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-978a4b52-e472-47cb-b525-f7a5144cf14e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:27.811695 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-978a4b52-e472-47cb-b525-f7a5144cf14e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:27.819112 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-978a4b52-e472-47cb-b525-f7a5144cf14e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:27.819557 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-978a4b52-e472-47cb-b525-f7a5144cf14e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:27.820348 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-978a4b52-e472-47cb-b525-f7a5144cf14e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:27.820782 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-978a4b52-e472-47cb-b525-f7a5144cf14e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:27.954521 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-978a4b52-e472-47cb-b525-f7a5144cf14e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:27.962001 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-978a4b52-e472-47cb-b525-f7a5144cf14e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1314 microversion: 2.1 time: 0.156145 Jun 29 11:42:27.962563 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 604/1207] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:27 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:28.978455 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f9b2a873-cf6b-4bf2-8991-06219982f34e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:28.979066 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f9b2a873-cf6b-4bf2-8991-06219982f34e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:28.985677 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9b2a873-cf6b-4bf2-8991-06219982f34e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:28.986128 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9b2a873-cf6b-4bf2-8991-06219982f34e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:28.986898 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9b2a873-cf6b-4bf2-8991-06219982f34e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:28.987705 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9b2a873-cf6b-4bf2-8991-06219982f34e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:29.113936 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f9b2a873-cf6b-4bf2-8991-06219982f34e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:29.132637 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f9b2a873-cf6b-4bf2-8991-06219982f34e tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1497 microversion: 2.1 time: 0.158061 Jun 29 11:42:29.133497 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 604/1208] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:28 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:30.126802 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-627b6762-da05-4b8a-b74d-9dd242b530e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:30.127376 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-627b6762-da05-4b8a-b74d-9dd242b530e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:30.133817 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-627b6762-da05-4b8a-b74d-9dd242b530e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:30.134258 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-627b6762-da05-4b8a-b74d-9dd242b530e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:30.135016 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-627b6762-da05-4b8a-b74d-9dd242b530e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:30.135446 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-627b6762-da05-4b8a-b74d-9dd242b530e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:30.160246 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-627b6762-da05-4b8a-b74d-9dd242b530e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:42:30.498426 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-627b6762-da05-4b8a-b74d-9dd242b530e4 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 204 len: 0 microversion: 2.1 time: 0.375204 Jun 29 11:42:30.499026 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 605/1209] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:42:30 2022] DELETE /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:42:30.507606 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6c9968c3-491e-4c4c-bf27-c0552124e84f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:30.508313 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6c9968c3-491e-4c4c-bf27-c0552124e84f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:30.514808 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c9968c3-491e-4c4c-bf27-c0552124e84f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:30.515250 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c9968c3-491e-4c4c-bf27-c0552124e84f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:30.516036 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c9968c3-491e-4c4c-bf27-c0552124e84f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:30.516481 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c9968c3-491e-4c4c-bf27-c0552124e84f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:30.648510 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6c9968c3-491e-4c4c-bf27-c0552124e84f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:30.656001 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6c9968c3-491e-4c4c-bf27-c0552124e84f tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1503 microversion: 2.1 time: 0.152203 Jun 29 11:42:30.656563 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 605/1210] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:30 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:31.673357 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8377c6ff-2d1a-4c88-94d8-9254fb39b2aa tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:31.674063 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8377c6ff-2d1a-4c88-94d8-9254fb39b2aa tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:31.680457 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8377c6ff-2d1a-4c88-94d8-9254fb39b2aa tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:31.680906 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8377c6ff-2d1a-4c88-94d8-9254fb39b2aa tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:31.681665 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8377c6ff-2d1a-4c88-94d8-9254fb39b2aa tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:31.682100 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8377c6ff-2d1a-4c88-94d8-9254fb39b2aa tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:31.810339 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8377c6ff-2d1a-4c88-94d8-9254fb39b2aa tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:31.817805 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8377c6ff-2d1a-4c88-94d8-9254fb39b2aa tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1503 microversion: 2.1 time: 0.148704 Jun 29 11:42:31.824832 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 606/1211] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:31 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:32.570789 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-96e26cc2-6861-416a-b5ca-e00fc2b20627 req-e5b6cf41-b39d-47d6-ab57-a3d1cb3eadcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3de0b6-a984-4965-a6c7-f221c37909c5", "name": "network-vif-deleted", "tag": "de7542aa-d4a1-4f09-801f-c2b80f216477"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:42:32.579438 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-96e26cc2-6861-416a-b5ca-e00fc2b20627 req-e5b6cf41-b39d-47d6-ab57-a3d1cb3eadcf service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:32.579901 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-96e26cc2-6861-416a-b5ca-e00fc2b20627 req-e5b6cf41-b39d-47d6-ab57-a3d1cb3eadcf service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:32.592401 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-96e26cc2-6861-416a-b5ca-e00fc2b20627 req-e5b6cf41-b39d-47d6-ab57-a3d1cb3eadcf service nova] Creating event network-vif-deleted:de7542aa-d4a1-4f09-801f-c2b80f216477 for instance 7a3de0b6-a984-4965-a6c7-f221c37909c5 on hv-cinder-84733 Jun 29 11:42:32.598231 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-96e26cc2-6861-416a-b5ca-e00fc2b20627 req-e5b6cf41-b39d-47d6-ab57-a3d1cb3eadcf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031145 Jun 29 11:42:32.602834 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 606/1212] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:42:32.834638 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cbea283a-3657-45d9-bc65-9cdb0b232fe9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:32.835227 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cbea283a-3657-45d9-bc65-9cdb0b232fe9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:32.841812 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbea283a-3657-45d9-bc65-9cdb0b232fe9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:32.842259 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbea283a-3657-45d9-bc65-9cdb0b232fe9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:32.843032 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbea283a-3657-45d9-bc65-9cdb0b232fe9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:32.843474 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbea283a-3657-45d9-bc65-9cdb0b232fe9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:32.914205 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cbea283a-3657-45d9-bc65-9cdb0b232fe9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6271b17d93a947beb71b5a42e70db55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f099825879470bba2817a0d02c0e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:42:32.924278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cbea283a-3657-45d9-bc65-9cdb0b232fe9 tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 200 len: 1299 microversion: 2.1 time: 0.091208 Jun 29 11:42:32.924278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 607/1213] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:32 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:42:33.939966 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eeb61a73-7d4d-4a15-ba74-3da7c565a3fb tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:42:33.940656 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eeb61a73-7d4d-4a15-ba74-3da7c565a3fb tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] [instance: 7a3de0b6-a984-4965-a6c7-f221c37909c5] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:42:33.946795 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eeb61a73-7d4d-4a15-ba74-3da7c565a3fb tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:33.947227 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eeb61a73-7d4d-4a15-ba74-3da7c565a3fb tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:33.948010 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eeb61a73-7d4d-4a15-ba74-3da7c565a3fb tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:42:33.948442 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eeb61a73-7d4d-4a15-ba74-3da7c565a3fb tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:42:33.961794 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-eeb61a73-7d4d-4a15-ba74-3da7c565a3fb tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] HTTP exception thrown: Instance 7a3de0b6-a984-4965-a6c7-f221c37909c5 could not be found. Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eeb61a73-7d4d-4a15-ba74-3da7c565a3fb tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Request method failure captured: Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 HTTP/1.1 Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDp_KcBPDZVo8SBVtCe5s7FiBiruXktFkmMydzuudBGCJ1ijm8oA7qEXsFvTU7jokCeMkcewmcdWN3TPol8WzP9gaQpVCIoru1_DMsysbfEU4JHwNEqbXHI2aq235VdCmNsOeIKGHfdQU_ukk-9o3japPlMCHekV4Nph5L3Ob6CQyMs Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: b0f099825879470bba2817a0d02c0e84 Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesActionsTest-1590178576 Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:42:33.963373 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:42:33.965303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b0f099825879470bba2817a0d02c0e84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b0f099825879470bba2817a0d02c0e84", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0f099825879470bba2817a0d02c0e84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0f099825879470bba2817a0d02c0e84"}]}] Jun 29 11:42:33.965303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesActionsTest-1590178576 Jun 29 11:42:33.965303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: b0f099825879470bba2817a0d02c0e84 Jun 29 11:42:33.965303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesActionsTest-1590178576 Jun 29 11:42:33.965303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesActionsTest-1590178576-project Jun 29 11:42:33.965303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:42:33.965303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:42:33.965303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: 6271b17d93a947beb71b5a42e70db55a Jun 29 11:42:33.965303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesActionsTest-1590178576-project Jun 29 11:42:33.965303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:42:33.965303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 7a3de0b6-a984-4965-a6c7-f221c37909c5 could not be found. Jun 29 11:42:33.965303 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': '7a3de0b6-a984-4965-a6c7-f221c37909c5'} Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a3de0b6-a984-4965-a6c7-f221c37909c5 could not be found. Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:42:33.966461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a3de0b6-a984-4965-a6c7-f221c37909c5 could not be found. Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a3de0b6-a984-4965-a6c7-f221c37909c5 could not be found. Jun 29 11:42:33.968260 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:42:33.969820 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eeb61a73-7d4d-4a15-ba74-3da7c565a3fb tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] Returning 404 to user: Instance 7a3de0b6-a984-4965-a6c7-f221c37909c5 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:42:33.969820 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eeb61a73-7d4d-4a15-ba74-3da7c565a3fb tempest-VolumesActionsTest-1590178576 tempest-VolumesActionsTest-1590178576-project] 10.222.0.44 "GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5" status: 404 len: 111 microversion: 2.1 time: 0.029455 Jun 29 11:42:33.969820 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 607/1214] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:42:33 2022] GET /compute/v2.1/servers/7a3de0b6-a984-4965-a6c7-f221c37909c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:43:52.392927 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:43:52.393653 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Wed Jun 29 11:43:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:44:36.492438 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:44:36.493212 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:44:36.497281 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0ab378ae-9fda-4ad9-bfe8-0591bd982d0f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:44:36.497814 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0ab378ae-9fda-4ad9-bfe8-0591bd982d0f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:36.503573 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab378ae-9fda-4ad9-bfe8-0591bd982d0f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:36.504059 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab378ae-9fda-4ad9-bfe8-0591bd982d0f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:36.509702 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab378ae-9fda-4ad9-bfe8-0591bd982d0f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:36.509702 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab378ae-9fda-4ad9-bfe8-0591bd982d0f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:36.528632 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-0ab378ae-9fda-4ad9-bfe8-0591bd982d0f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lazy-loading 'flavor' on Instance uuid 7076be8a-f02b-49f2-9124-c2a539ac2cef {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 11:44:37.208842 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0ab378ae-9fda-4ad9-bfe8-0591bd982d0f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "POST /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef/action" status: 202 len: 0 microversion: 2.1 time: 0.716193 Jun 29 11:44:37.208842 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 608/1215] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:44:36 2022] POST /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:44:37.213942 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR oslo.messaging._drivers.impl_rabbit [-] [090bf89e-f246-4b4c-be17-46e145d83f83] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 29 11:44:37.214507 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=19 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:44:37.215250 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=47 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:44:37.219355 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dea9adb7-1653-48c4-864b-df0296871a76 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:37.220032 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dea9adb7-1653-48c4-864b-df0296871a76 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:37.225844 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dea9adb7-1653-48c4-864b-df0296871a76 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:37.226320 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dea9adb7-1653-48c4-864b-df0296871a76 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:37.227084 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dea9adb7-1653-48c4-864b-df0296871a76 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:37.227519 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dea9adb7-1653-48c4-864b-df0296871a76 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:37.362013 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dea9adb7-1653-48c4-864b-df0296871a76 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:37.374301 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dea9adb7-1653-48c4-864b-df0296871a76 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.157920 Jun 29 11:44:37.374301 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 608/1216] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:37 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:38.389182 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e31b0aec-a9cd-4e99-9eea-f6cecc045345 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:38.389884 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e31b0aec-a9cd-4e99-9eea-f6cecc045345 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:38.396206 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e31b0aec-a9cd-4e99-9eea-f6cecc045345 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:38.396644 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e31b0aec-a9cd-4e99-9eea-f6cecc045345 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:38.397390 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e31b0aec-a9cd-4e99-9eea-f6cecc045345 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:38.397817 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e31b0aec-a9cd-4e99-9eea-f6cecc045345 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:38.525428 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e31b0aec-a9cd-4e99-9eea-f6cecc045345 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:38.533359 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e31b0aec-a9cd-4e99-9eea-f6cecc045345 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.149134 Jun 29 11:44:38.533906 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 609/1217] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:38 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:39.551000 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4bd8dc6f-013f-45e7-abcb-6b754d5133f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:39.551703 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4bd8dc6f-013f-45e7-abcb-6b754d5133f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:39.559143 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4bd8dc6f-013f-45e7-abcb-6b754d5133f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:39.559585 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4bd8dc6f-013f-45e7-abcb-6b754d5133f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:39.560372 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4bd8dc6f-013f-45e7-abcb-6b754d5133f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:39.560804 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4bd8dc6f-013f-45e7-abcb-6b754d5133f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:39.577412 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] [090bf89e-f246-4b4c-be17-46e145d83f83] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 40736. Jun 29 11:44:39.952498 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4bd8dc6f-013f-45e7-abcb-6b754d5133f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:39.960115 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4bd8dc6f-013f-45e7-abcb-6b754d5133f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.413510 Jun 29 11:44:39.960682 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 609/1218] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:39 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:40.977884 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-54d965d7-eac0-4def-aa28-44539fc4744a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:40.978488 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-54d965d7-eac0-4def-aa28-44539fc4744a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:40.986963 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54d965d7-eac0-4def-aa28-44539fc4744a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:40.987414 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54d965d7-eac0-4def-aa28-44539fc4744a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:40.988195 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54d965d7-eac0-4def-aa28-44539fc4744a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:40.988626 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54d965d7-eac0-4def-aa28-44539fc4744a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:41.115762 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-54d965d7-eac0-4def-aa28-44539fc4744a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:41.123611 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-54d965d7-eac0-4def-aa28-44539fc4744a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.149642 Jun 29 11:44:41.124204 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 610/1219] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:40 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:42.140719 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-532d3975-cbd5-4d8f-82c2-a9228e2540ec tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:42.141300 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-532d3975-cbd5-4d8f-82c2-a9228e2540ec tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:42.147587 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-532d3975-cbd5-4d8f-82c2-a9228e2540ec tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:42.148056 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-532d3975-cbd5-4d8f-82c2-a9228e2540ec tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:42.148804 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-532d3975-cbd5-4d8f-82c2-a9228e2540ec tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:42.149230 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-532d3975-cbd5-4d8f-82c2-a9228e2540ec tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:42.281671 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-532d3975-cbd5-4d8f-82c2-a9228e2540ec tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:42.289118 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-532d3975-cbd5-4d8f-82c2-a9228e2540ec tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.152474 Jun 29 11:44:42.289687 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 610/1220] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:42 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:43.307043 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-78e6f0ee-0f97-44d3-be09-697813a86e62 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:43.307682 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-78e6f0ee-0f97-44d3-be09-697813a86e62 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:43.315243 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-78e6f0ee-0f97-44d3-be09-697813a86e62 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:43.315684 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-78e6f0ee-0f97-44d3-be09-697813a86e62 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:43.316476 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-78e6f0ee-0f97-44d3-be09-697813a86e62 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:43.316903 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-78e6f0ee-0f97-44d3-be09-697813a86e62 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:43.447195 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-78e6f0ee-0f97-44d3-be09-697813a86e62 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:43.454765 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-78e6f0ee-0f97-44d3-be09-697813a86e62 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.151677 Jun 29 11:44:43.455275 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 611/1221] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:43 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:44.471730 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-30cc6100-3316-4b67-bca5-8634cd25b3f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:44.472414 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-30cc6100-3316-4b67-bca5-8634cd25b3f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:44.478964 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30cc6100-3316-4b67-bca5-8634cd25b3f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:44.479439 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30cc6100-3316-4b67-bca5-8634cd25b3f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:44.480236 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30cc6100-3316-4b67-bca5-8634cd25b3f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:44.480671 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30cc6100-3316-4b67-bca5-8634cd25b3f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:44.606659 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-30cc6100-3316-4b67-bca5-8634cd25b3f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:44.614603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-30cc6100-3316-4b67-bca5-8634cd25b3f5 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.146631 Jun 29 11:44:44.615416 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 611/1222] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:44 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:45.631293 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f7746bdb-1db0-4c4f-a35a-707ff9e10f0d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:45.631860 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f7746bdb-1db0-4c4f-a35a-707ff9e10f0d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:45.638317 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7746bdb-1db0-4c4f-a35a-707ff9e10f0d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:45.638799 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7746bdb-1db0-4c4f-a35a-707ff9e10f0d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:45.639562 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7746bdb-1db0-4c4f-a35a-707ff9e10f0d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:45.640543 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7746bdb-1db0-4c4f-a35a-707ff9e10f0d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:45.774252 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f7746bdb-1db0-4c4f-a35a-707ff9e10f0d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:45.781828 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f7746bdb-1db0-4c4f-a35a-707ff9e10f0d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.154517 Jun 29 11:44:45.782410 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 612/1223] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:45 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:46.799123 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-88fff0f4-3e53-4b78-9767-47ae4d59f8ac tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:46.799731 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-88fff0f4-3e53-4b78-9767-47ae4d59f8ac tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:46.806232 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88fff0f4-3e53-4b78-9767-47ae4d59f8ac tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:46.806679 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88fff0f4-3e53-4b78-9767-47ae4d59f8ac tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:46.807448 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88fff0f4-3e53-4b78-9767-47ae4d59f8ac tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:46.807916 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88fff0f4-3e53-4b78-9767-47ae4d59f8ac tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:46.935860 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-88fff0f4-3e53-4b78-9767-47ae4d59f8ac tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:46.943324 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-88fff0f4-3e53-4b78-9767-47ae4d59f8ac tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.148722 Jun 29 11:44:46.943907 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 612/1224] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:46 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:47.224873 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:44:47.225035 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Wed Jun 29 11:44:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:44:47.959672 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-95f93ef3-01d9-4882-b7fa-c7912055e004 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:47.960338 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-95f93ef3-01d9-4882-b7fa-c7912055e004 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:47.966874 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95f93ef3-01d9-4882-b7fa-c7912055e004 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:47.967326 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95f93ef3-01d9-4882-b7fa-c7912055e004 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:47.968117 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95f93ef3-01d9-4882-b7fa-c7912055e004 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:47.968550 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95f93ef3-01d9-4882-b7fa-c7912055e004 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:48.170679 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-95f93ef3-01d9-4882-b7fa-c7912055e004 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:48.178707 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-95f93ef3-01d9-4882-b7fa-c7912055e004 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.222885 Jun 29 11:44:48.179278 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 613/1225] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:47 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:49.196398 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0a1f6006-1852-42f1-87ae-f9f9ccfec756 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:49.197035 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0a1f6006-1852-42f1-87ae-f9f9ccfec756 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:49.203592 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0a1f6006-1852-42f1-87ae-f9f9ccfec756 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:49.204090 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0a1f6006-1852-42f1-87ae-f9f9ccfec756 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:49.205347 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0a1f6006-1852-42f1-87ae-f9f9ccfec756 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:49.205347 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0a1f6006-1852-42f1-87ae-f9f9ccfec756 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:49.333122 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0a1f6006-1852-42f1-87ae-f9f9ccfec756 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:49.340888 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0a1f6006-1852-42f1-87ae-f9f9ccfec756 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.148360 Jun 29 11:44:49.341510 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 613/1226] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:49 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:50.360412 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fe863902-e92c-466a-abab-2a203b1d26c2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:50.361025 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fe863902-e92c-466a-abab-2a203b1d26c2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:50.367708 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe863902-e92c-466a-abab-2a203b1d26c2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:50.370956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe863902-e92c-466a-abab-2a203b1d26c2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:50.370956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe863902-e92c-466a-abab-2a203b1d26c2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:50.370956 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe863902-e92c-466a-abab-2a203b1d26c2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:50.500790 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe863902-e92c-466a-abab-2a203b1d26c2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:50.508359 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fe863902-e92c-466a-abab-2a203b1d26c2 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.152012 Jun 29 11:44:50.510644 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 614/1227] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:50 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:51.527488 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1fd4f65f-7a45-4062-85dd-365e8039f7f7 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:51.528049 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1fd4f65f-7a45-4062-85dd-365e8039f7f7 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:51.535054 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1fd4f65f-7a45-4062-85dd-365e8039f7f7 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:51.535620 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1fd4f65f-7a45-4062-85dd-365e8039f7f7 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:51.536400 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1fd4f65f-7a45-4062-85dd-365e8039f7f7 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:51.536840 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1fd4f65f-7a45-4062-85dd-365e8039f7f7 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:51.668512 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1fd4f65f-7a45-4062-85dd-365e8039f7f7 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:51.676499 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1fd4f65f-7a45-4062-85dd-365e8039f7f7 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1508 microversion: 2.1 time: 0.152974 Jun 29 11:44:51.677060 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 614/1228] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:51 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:51.694876 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb195535-852b-4450-9b45-d505de57ccae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:44:51.695412 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb195535-852b-4450-9b45-d505de57ccae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:51.701757 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb195535-852b-4450-9b45-d505de57ccae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:51.702225 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb195535-852b-4450-9b45-d505de57ccae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:51.705770 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb195535-852b-4450-9b45-d505de57ccae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:51.705770 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb195535-852b-4450-9b45-d505de57ccae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:52.151415 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bb195535-852b-4450-9b45-d505de57ccae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [155ba43b-267b-4570-ada4-6e3634936e9e] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 11:44:53.159123 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [None req-bb195535-852b-4450-9b45-d505de57ccae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [155ba43b-267b-4570-ada4-6e3634936e9e] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 40784. Jun 29 11:44:53.162166 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb195535-852b-4450-9b45-d505de57ccae tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "POST /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef/action" status: 202 len: 0 microversion: 2.1 time: 1.471448 Jun 29 11:44:53.162957 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 615/1229] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jun 29 11:44:51 2022] POST /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef/action => generated 0 bytes in 1473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:44:53.170829 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a8ad2e7c-0a45-4c30-9074-8facf2d39a56 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:53.172083 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a8ad2e7c-0a45-4c30-9074-8facf2d39a56 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:53.178461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8ad2e7c-0a45-4c30-9074-8facf2d39a56 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:53.178907 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8ad2e7c-0a45-4c30-9074-8facf2d39a56 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:53.179662 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8ad2e7c-0a45-4c30-9074-8facf2d39a56 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:53.180111 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8ad2e7c-0a45-4c30-9074-8facf2d39a56 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:53.315901 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a8ad2e7c-0a45-4c30-9074-8facf2d39a56 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:53.323313 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a8ad2e7c-0a45-4c30-9074-8facf2d39a56 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1516 microversion: 2.1 time: 0.156355 Jun 29 11:44:53.323894 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 615/1230] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:53 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:54.298592 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-bc3b4588-9dbc-4c8a-a654-076def49cb4f req-8ff963e3-8cf5-4513-bab2-4e24faaad81f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7076be8a-f02b-49f2-9124-c2a539ac2cef", "name": "network-vif-unplugged", "status": "completed", "tag": "4b70fef6-1e62-47b1-a889-8e64a22f1d6c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:44:54.307619 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bc3b4588-9dbc-4c8a-a654-076def49cb4f req-8ff963e3-8cf5-4513-bab2-4e24faaad81f service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:54.308125 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bc3b4588-9dbc-4c8a-a654-076def49cb4f req-8ff963e3-8cf5-4513-bab2-4e24faaad81f service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:54.318932 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.compute.server_external_events [req-bc3b4588-9dbc-4c8a-a654-076def49cb4f req-8ff963e3-8cf5-4513-bab2-4e24faaad81f service nova] Unable to find a host for instance 7076be8a-f02b-49f2-9124-c2a539ac2cef. Dropping event network-vif-unplugged {{(pid=117920) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 29 11:44:54.319800 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-bc3b4588-9dbc-4c8a-a654-076def49cb4f req-8ff963e3-8cf5-4513-bab2-4e24faaad81f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026219 Jun 29 11:44:54.320401 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 616/1231] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 29 11:44:54.340236 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f9f450c0-c73d-44ce-863f-06f5df317c2e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:54.340847 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f9f450c0-c73d-44ce-863f-06f5df317c2e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:54.347267 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9f450c0-c73d-44ce-863f-06f5df317c2e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:54.347709 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9f450c0-c73d-44ce-863f-06f5df317c2e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:54.348501 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9f450c0-c73d-44ce-863f-06f5df317c2e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:54.348936 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9f450c0-c73d-44ce-863f-06f5df317c2e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:54.487882 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f9f450c0-c73d-44ce-863f-06f5df317c2e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:54.495443 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f9f450c0-c73d-44ce-863f-06f5df317c2e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1516 microversion: 2.1 time: 0.159064 Jun 29 11:44:54.496016 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 616/1232] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:54 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:55.512881 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-55c3a7c1-8d65-4981-ad95-db4a65a26cbe tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:55.519155 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-55c3a7c1-8d65-4981-ad95-db4a65a26cbe tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:55.520202 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55c3a7c1-8d65-4981-ad95-db4a65a26cbe tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:55.520649 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55c3a7c1-8d65-4981-ad95-db4a65a26cbe tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:55.521405 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55c3a7c1-8d65-4981-ad95-db4a65a26cbe tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:55.521830 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55c3a7c1-8d65-4981-ad95-db4a65a26cbe tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:55.652870 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-55c3a7c1-8d65-4981-ad95-db4a65a26cbe tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:55.660397 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-55c3a7c1-8d65-4981-ad95-db4a65a26cbe tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1518 microversion: 2.1 time: 0.151826 Jun 29 11:44:55.660964 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 617/1233] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:55 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:56.677878 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1bb7ad6c-98f1-4eaf-8098-cfbd5768e050 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:56.678495 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1bb7ad6c-98f1-4eaf-8098-cfbd5768e050 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:56.685207 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1bb7ad6c-98f1-4eaf-8098-cfbd5768e050 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:56.685657 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1bb7ad6c-98f1-4eaf-8098-cfbd5768e050 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:56.686433 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1bb7ad6c-98f1-4eaf-8098-cfbd5768e050 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:56.687360 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1bb7ad6c-98f1-4eaf-8098-cfbd5768e050 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:56.888603 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1bb7ad6c-98f1-4eaf-8098-cfbd5768e050 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:56.896714 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1bb7ad6c-98f1-4eaf-8098-cfbd5768e050 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1574 microversion: 2.1 time: 0.222720 Jun 29 11:44:56.897367 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 617/1234] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:56 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1574 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:44:57.913766 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3903287-fe5b-4c2d-b0c7-7d6768fa9d13 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:57.914406 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3903287-fe5b-4c2d-b0c7-7d6768fa9d13 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:57.920781 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3903287-fe5b-4c2d-b0c7-7d6768fa9d13 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:57.921231 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3903287-fe5b-4c2d-b0c7-7d6768fa9d13 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:57.921980 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3903287-fe5b-4c2d-b0c7-7d6768fa9d13 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:57.922410 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3903287-fe5b-4c2d-b0c7-7d6768fa9d13 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:58.117327 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3903287-fe5b-4c2d-b0c7-7d6768fa9d13 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:58.124806 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3903287-fe5b-4c2d-b0c7-7d6768fa9d13 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1574 microversion: 2.1 time: 0.214973 Jun 29 11:44:58.125374 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 618/1235] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:57 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1574 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:44:59.142571 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bec583cf-ef66-4ab8-b8df-98f921a30e3d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:44:59.143201 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bec583cf-ef66-4ab8-b8df-98f921a30e3d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:44:59.149744 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bec583cf-ef66-4ab8-b8df-98f921a30e3d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:59.150187 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bec583cf-ef66-4ab8-b8df-98f921a30e3d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:59.150932 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bec583cf-ef66-4ab8-b8df-98f921a30e3d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:44:59.151358 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bec583cf-ef66-4ab8-b8df-98f921a30e3d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:44:59.279034 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bec583cf-ef66-4ab8-b8df-98f921a30e3d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:44:59.287021 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bec583cf-ef66-4ab8-b8df-98f921a30e3d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1574 microversion: 2.1 time: 0.149184 Jun 29 11:44:59.287583 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 618/1236] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:44:59 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:45:00.304113 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-90a996e1-ab71-4c31-9b44-0fb2b15b41ff tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:45:00.304733 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-90a996e1-ab71-4c31-9b44-0fb2b15b41ff tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:45:00.311385 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90a996e1-ab71-4c31-9b44-0fb2b15b41ff tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:00.311857 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90a996e1-ab71-4c31-9b44-0fb2b15b41ff tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:00.312609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90a996e1-ab71-4c31-9b44-0fb2b15b41ff tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:00.313038 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90a996e1-ab71-4c31-9b44-0fb2b15b41ff tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:00.493244 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-90a996e1-ab71-4c31-9b44-0fb2b15b41ff tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:45:00.501310 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-90a996e1-ab71-4c31-9b44-0fb2b15b41ff tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1574 microversion: 2.1 time: 0.201258 Jun 29 11:45:00.501865 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 619/1237] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:45:00 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:45:01.518786 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4fd36b05-f258-49d1-ab8c-e8bf980986ba tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:45:01.519335 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4fd36b05-f258-49d1-ab8c-e8bf980986ba tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:45:01.525729 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4fd36b05-f258-49d1-ab8c-e8bf980986ba tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:01.526171 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4fd36b05-f258-49d1-ab8c-e8bf980986ba tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:01.526912 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4fd36b05-f258-49d1-ab8c-e8bf980986ba tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:01.527340 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4fd36b05-f258-49d1-ab8c-e8bf980986ba tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:01.654336 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4fd36b05-f258-49d1-ab8c-e8bf980986ba tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:45:01.662406 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4fd36b05-f258-49d1-ab8c-e8bf980986ba tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1574 microversion: 2.1 time: 0.148059 Jun 29 11:45:01.662966 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 619/1238] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:45:01 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:45:02.679057 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fde643c3-b970-42a2-9745-b89715c5091a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:45:02.679606 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fde643c3-b970-42a2-9745-b89715c5091a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:45:02.686660 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fde643c3-b970-42a2-9745-b89715c5091a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:02.687102 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fde643c3-b970-42a2-9745-b89715c5091a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:02.687926 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fde643c3-b970-42a2-9745-b89715c5091a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:02.688930 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fde643c3-b970-42a2-9745-b89715c5091a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:02.822989 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fde643c3-b970-42a2-9745-b89715c5091a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:45:02.831013 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fde643c3-b970-42a2-9745-b89715c5091a tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1574 microversion: 2.1 time: 0.155965 Jun 29 11:45:02.831572 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 620/1239] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:45:02 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:45:03.847913 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c86fce6e-18bc-4efe-b46f-b7dca0c7edc3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:45:03.848476 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c86fce6e-18bc-4efe-b46f-b7dca0c7edc3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:45:03.854866 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c86fce6e-18bc-4efe-b46f-b7dca0c7edc3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:03.855307 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c86fce6e-18bc-4efe-b46f-b7dca0c7edc3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:03.856085 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c86fce6e-18bc-4efe-b46f-b7dca0c7edc3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:03.856515 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c86fce6e-18bc-4efe-b46f-b7dca0c7edc3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:03.996249 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c86fce6e-18bc-4efe-b46f-b7dca0c7edc3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:45:04.003672 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c86fce6e-18bc-4efe-b46f-b7dca0c7edc3 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1574 microversion: 2.1 time: 0.160336 Jun 29 11:45:04.007345 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 620/1240] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:45:03 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:45:05.020779 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-898d3074-d515-4b93-aad8-e1d70ecab6eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:45:05.021395 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-898d3074-d515-4b93-aad8-e1d70ecab6eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:45:05.028008 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-898d3074-d515-4b93-aad8-e1d70ecab6eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:05.028452 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-898d3074-d515-4b93-aad8-e1d70ecab6eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:05.029245 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-898d3074-d515-4b93-aad8-e1d70ecab6eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:05.029658 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-898d3074-d515-4b93-aad8-e1d70ecab6eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:05.162565 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-898d3074-d515-4b93-aad8-e1d70ecab6eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:45:05.170072 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-898d3074-d515-4b93-aad8-e1d70ecab6eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1574 microversion: 2.1 time: 0.153097 Jun 29 11:45:05.170574 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 621/1241] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:45:05 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:45:06.187539 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ac0b7126-ce15-417c-88d2-4fded36d04eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:45:06.188159 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ac0b7126-ce15-417c-88d2-4fded36d04eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:45:06.195146 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ac0b7126-ce15-417c-88d2-4fded36d04eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:06.195602 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ac0b7126-ce15-417c-88d2-4fded36d04eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:06.196392 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ac0b7126-ce15-417c-88d2-4fded36d04eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:06.196826 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ac0b7126-ce15-417c-88d2-4fded36d04eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:06.329965 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ac0b7126-ce15-417c-88d2-4fded36d04eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:45:06.337504 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ac0b7126-ce15-417c-88d2-4fded36d04eb tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1574 microversion: 2.1 time: 0.153886 Jun 29 11:45:06.338072 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 621/1242] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:45:06 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:45:07.354389 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5d44957e-9ab2-41a0-a2b1-2037ec09f5b8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:45:07.354988 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5d44957e-9ab2-41a0-a2b1-2037ec09f5b8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:45:07.357472 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=31 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:45:07.362228 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d44957e-9ab2-41a0-a2b1-2037ec09f5b8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:07.362683 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d44957e-9ab2-41a0-a2b1-2037ec09f5b8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:07.363447 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d44957e-9ab2-41a0-a2b1-2037ec09f5b8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:07.363907 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d44957e-9ab2-41a0-a2b1-2037ec09f5b8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:07.368076 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:45:07.491609 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5d44957e-9ab2-41a0-a2b1-2037ec09f5b8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:45:07.499036 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5d44957e-9ab2-41a0-a2b1-2037ec09f5b8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1574 microversion: 2.1 time: 0.148507 Jun 29 11:45:07.499598 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 622/1243] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:45:07 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:45:08.433282 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-68360f5e-d609-46ef-9bd7-806d05328bd3 req-c8000058-e9c0-4e1d-8872-9a979d1485a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7076be8a-f02b-49f2-9124-c2a539ac2cef", "name": "network-vif-plugged", "status": "completed", "tag": "4b70fef6-1e62-47b1-a889-8e64a22f1d6c"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:45:08.437159 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=29 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:45:08.442409 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-68360f5e-d609-46ef-9bd7-806d05328bd3 req-c8000058-e9c0-4e1d-8872-9a979d1485a8 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:08.446330 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-68360f5e-d609-46ef-9bd7-806d05328bd3 req-c8000058-e9c0-4e1d-8872-9a979d1485a8 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:08.453667 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-68360f5e-d609-46ef-9bd7-806d05328bd3 req-c8000058-e9c0-4e1d-8872-9a979d1485a8 service nova] Creating event network-vif-plugged:4b70fef6-1e62-47b1-a889-8e64a22f1d6c for instance 7076be8a-f02b-49f2-9124-c2a539ac2cef on hv-cinder-84733 Jun 29 11:45:08.459636 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-68360f5e-d609-46ef-9bd7-806d05328bd3 req-c8000058-e9c0-4e1d-8872-9a979d1485a8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030398 Jun 29 11:45:08.460419 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 622/1244] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:45:08.517750 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b7a8efc6-fc58-454f-be32-a4ed7afe845d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:45:08.518464 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b7a8efc6-fc58-454f-be32-a4ed7afe845d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:45:08.525975 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b7a8efc6-fc58-454f-be32-a4ed7afe845d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:08.526417 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b7a8efc6-fc58-454f-be32-a4ed7afe845d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:08.527168 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b7a8efc6-fc58-454f-be32-a4ed7afe845d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:08.527597 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b7a8efc6-fc58-454f-be32-a4ed7afe845d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:08.663094 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b7a8efc6-fc58-454f-be32-a4ed7afe845d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:45:08.670614 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b7a8efc6-fc58-454f-be32-a4ed7afe845d tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1574 microversion: 2.1 time: 0.157397 Jun 29 11:45:08.671241 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 623/1245] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:45:08 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:45:09.689379 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6fe4146f-6daa-40a7-8bca-b0d93705e18f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:45:09.690058 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6fe4146f-6daa-40a7-8bca-b0d93705e18f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:45:09.696692 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6fe4146f-6daa-40a7-8bca-b0d93705e18f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:09.697132 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6fe4146f-6daa-40a7-8bca-b0d93705e18f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:09.697893 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6fe4146f-6daa-40a7-8bca-b0d93705e18f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:09.698308 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6fe4146f-6daa-40a7-8bca-b0d93705e18f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:09.701006 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=87 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:45:09.833983 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6fe4146f-6daa-40a7-8bca-b0d93705e18f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:45:09.841385 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6fe4146f-6daa-40a7-8bca-b0d93705e18f tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1574 microversion: 2.1 time: 0.157482 Jun 29 11:45:09.841937 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 623/1246] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:45:09 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:45:10.858397 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6807ed6c-9132-47e6-9dfd-2cd29efd2354 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:45:10.859007 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6807ed6c-9132-47e6-9dfd-2cd29efd2354 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:45:10.866260 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6807ed6c-9132-47e6-9dfd-2cd29efd2354 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:10.866703 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6807ed6c-9132-47e6-9dfd-2cd29efd2354 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:10.867446 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6807ed6c-9132-47e6-9dfd-2cd29efd2354 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:45:10.867899 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6807ed6c-9132-47e6-9dfd-2cd29efd2354 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:45:10.998939 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6807ed6c-9132-47e6-9dfd-2cd29efd2354 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:45:11.006541 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6807ed6c-9132-47e6-9dfd-2cd29efd2354 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1561 microversion: 2.1 time: 0.151965 Jun 29 11:45:11.007129 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 624/1247] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:45:10 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:46:27.577714 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:46:27.578413 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Wed Jun 29 11:46:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:46:40.912948 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:46:40.913699 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=5 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:46:40.917603 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=5 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:46:40.921607 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=17 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:46:40.923155 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-29cb1a8f-c158-4408-b667-a6c2bb4a66e8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:46:40.923646 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-29cb1a8f-c158-4408-b667-a6c2bb4a66e8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:46:40.930225 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29cb1a8f-c158-4408-b667-a6c2bb4a66e8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:40.930674 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29cb1a8f-c158-4408-b667-a6c2bb4a66e8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:40.931438 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29cb1a8f-c158-4408-b667-a6c2bb4a66e8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:40.931909 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29cb1a8f-c158-4408-b667-a6c2bb4a66e8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:40.958633 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-29cb1a8f-c158-4408-b667-a6c2bb4a66e8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 11:46:40.988076 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-38d138fc-a676-43aa-a185-cee3e25d2ad3 req-5d5c2ca7-4f25-452f-aea4-8db730798576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7076be8a-f02b-49f2-9124-c2a539ac2cef", "tag": "4b70fef6-1e62-47b1-a889-8e64a22f1d6c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:46:40.996926 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-38d138fc-a676-43aa-a185-cee3e25d2ad3 req-5d5c2ca7-4f25-452f-aea4-8db730798576 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:40.997675 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-38d138fc-a676-43aa-a185-cee3e25d2ad3 req-5d5c2ca7-4f25-452f-aea4-8db730798576 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:41.010257 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-38d138fc-a676-43aa-a185-cee3e25d2ad3 req-5d5c2ca7-4f25-452f-aea4-8db730798576 service nova] Creating event network-changed:4b70fef6-1e62-47b1-a889-8e64a22f1d6c for instance 7076be8a-f02b-49f2-9124-c2a539ac2cef on hv-cinder-84733 Jun 29 11:46:41.016037 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-38d138fc-a676-43aa-a185-cee3e25d2ad3 req-5d5c2ca7-4f25-452f-aea4-8db730798576 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105705 Jun 29 11:46:41.016624 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 625/1248] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 11:46:41.340599 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-29cb1a8f-c158-4408-b667-a6c2bb4a66e8 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 204 len: 0 microversion: 2.1 time: 0.432611 Jun 29 11:46:41.344452 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 624/1249] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jun 29 11:46:40 2022] DELETE /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 11:46:41.351019 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-31e8e771-b8e3-468c-8836-f8be4211002e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:46:41.351776 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-31e8e771-b8e3-468c-8836-f8be4211002e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:46:41.358550 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31e8e771-b8e3-468c-8836-f8be4211002e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:41.358935 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31e8e771-b8e3-468c-8836-f8be4211002e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:41.359699 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31e8e771-b8e3-468c-8836-f8be4211002e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:41.360154 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31e8e771-b8e3-468c-8836-f8be4211002e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:41.496735 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-31e8e771-b8e3-468c-8836-f8be4211002e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:46:41.504709 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-31e8e771-b8e3-468c-8836-f8be4211002e tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.158676 Jun 29 11:46:41.505373 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 626/1250] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:46:41 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:46:42.522971 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1fd90d53-6433-4b4f-a3af-aa0a6c7ca433 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:46:42.523664 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1fd90d53-6433-4b4f-a3af-aa0a6c7ca433 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:46:42.530188 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1fd90d53-6433-4b4f-a3af-aa0a6c7ca433 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:42.530632 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1fd90d53-6433-4b4f-a3af-aa0a6c7ca433 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:42.531394 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1fd90d53-6433-4b4f-a3af-aa0a6c7ca433 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:42.531823 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1fd90d53-6433-4b4f-a3af-aa0a6c7ca433 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:42.731230 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1fd90d53-6433-4b4f-a3af-aa0a6c7ca433 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:46:42.739023 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1fd90d53-6433-4b4f-a3af-aa0a6c7ca433 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1567 microversion: 2.1 time: 0.220240 Jun 29 11:46:42.739666 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 625/1251] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:46:42 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:46:43.756918 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-faea5f6e-e12b-44d4-b60d-e95d531ac3ef tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:46:43.757469 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-faea5f6e-e12b-44d4-b60d-e95d531ac3ef tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:46:43.764301 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-faea5f6e-e12b-44d4-b60d-e95d531ac3ef tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:43.764743 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-faea5f6e-e12b-44d4-b60d-e95d531ac3ef tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:43.765492 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-faea5f6e-e12b-44d4-b60d-e95d531ac3ef tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:43.765920 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-faea5f6e-e12b-44d4-b60d-e95d531ac3ef tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:43.993258 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-faea5f6e-e12b-44d4-b60d-e95d531ac3ef tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:46:43.993258 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-faea5f6e-e12b-44d4-b60d-e95d531ac3ef tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1449 microversion: 2.1 time: 0.230528 Jun 29 11:46:43.993258 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 627/1252] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:46:43 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1449 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 11:46:43.994564 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-ee64ceb6-2ecf-4517-ac1a-f0211e88be87 req-968faca6-e84c-4f32-81b5-dbfbabce6f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7076be8a-f02b-49f2-9124-c2a539ac2cef", "name": "network-vif-deleted", "tag": "4b70fef6-1e62-47b1-a889-8e64a22f1d6c"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 11:46:43.995825 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ee64ceb6-2ecf-4517-ac1a-f0211e88be87 req-968faca6-e84c-4f32-81b5-dbfbabce6f52 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:43.996287 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ee64ceb6-2ecf-4517-ac1a-f0211e88be87 req-968faca6-e84c-4f32-81b5-dbfbabce6f52 service nova] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:44.007807 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-ee64ceb6-2ecf-4517-ac1a-f0211e88be87 req-968faca6-e84c-4f32-81b5-dbfbabce6f52 service nova] Creating event network-vif-deleted:4b70fef6-1e62-47b1-a889-8e64a22f1d6c for instance 7076be8a-f02b-49f2-9124-c2a539ac2cef on hv-cinder-84733 Jun 29 11:46:44.012735 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-ee64ceb6-2ecf-4517-ac1a-f0211e88be87 req-968faca6-e84c-4f32-81b5-dbfbabce6f52 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030365 Jun 29 11:46:44.013305 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 626/1253] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jun 29 11:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 11:46:45.001105 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c25ea259-259a-4e03-9092-e24bf2c95c46 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:46:45.001715 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c25ea259-259a-4e03-9092-e24bf2c95c46 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:46:45.008691 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c25ea259-259a-4e03-9092-e24bf2c95c46 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:45.009137 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c25ea259-259a-4e03-9092-e24bf2c95c46 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:45.009892 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c25ea259-259a-4e03-9092-e24bf2c95c46 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:45.010325 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c25ea259-259a-4e03-9092-e24bf2c95c46 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:45.071471 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c25ea259-259a-4e03-9092-e24bf2c95c46 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db0a0b5bcf4e6d8ee2593b21c415fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d5bbf32cb54de2a37895f53bcb9d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 11:46:45.079177 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c25ea259-259a-4e03-9092-e24bf2c95c46 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 200 len: 1219 microversion: 2.1 time: 0.081971 Jun 29 11:46:45.079768 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 628/1254] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:46:44 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 11:46:46.097876 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4cec1a72-f403-46a8-9d4f-538d8760e582 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:46:46.098568 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4cec1a72-f403-46a8-9d4f-538d8760e582 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] [instance: 7076be8a-f02b-49f2-9124-c2a539ac2cef] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 11:46:46.105348 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cec1a72-f403-46a8-9d4f-538d8760e582 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:46.105793 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cec1a72-f403-46a8-9d4f-538d8760e582 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:46.106548 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cec1a72-f403-46a8-9d4f-538d8760e582 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 11:46:46.106989 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cec1a72-f403-46a8-9d4f-538d8760e582 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Lock "fbe1565e-37f2-43ef-a64f-991bc8fd407f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 11:46:46.121265 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-4cec1a72-f403-46a8-9d4f-538d8760e582 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] HTTP exception thrown: Instance 7076be8a-f02b-49f2-9124-c2a539ac2cef could not be found. Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4cec1a72-f403-46a8-9d4f-538d8760e582 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Request method failure captured: Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef HTTP/1.1 Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept: application/json Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Connection: close Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Length: 0 Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Content-Type: application/json Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Host: 10.222.0.44 Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.9 Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABivDpa9iOJ8HCPML7WAsLVKJ492_WBxZxBeyiQGc1nhgABC4XfKKTe9eH7eeecGHUGVRvLO_4cVUxSaYNMoFc1VnrREf0R6Lw626GdFVyBBN7STLky4pOp3_IMzgggoQzYcT5n1Yr8qazfH6WONwDumsXvJo5wc1zzf0T97aoqJZVo1HY Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Id: 40d5bbf32cb54de2a37895f53bcb9d4a Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-TestShelveInstance-1363222227 Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Role: member,reader Jun 29 11:46:46.123142 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Roles: member,reader Jun 29 11:46:46.124985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/40d5bbf32cb54de2a37895f53bcb9d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_40d5bbf32cb54de2a37895f53bcb9d4a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/40d5bbf32cb54de2a37895f53bcb9d4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/40d5bbf32cb54de2a37895f53bcb9d4a"}]}] Jun 29 11:46:46.124985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-TestShelveInstance-1363222227 Jun 29 11:46:46.124985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 40d5bbf32cb54de2a37895f53bcb9d4a Jun 29 11:46:46.124985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-TestShelveInstance-1363222227 Jun 29 11:46:46.124985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User: tempest-TestShelveInstance-1363222227-project Jun 29 11:46:46.124985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Jun 29 11:46:46.124985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Jun 29 11:46:46.124985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Id: f9db0a0b5bcf4e6d8ee2593b21c415fb Jun 29 11:46:46.124985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-TestShelveInstance-1363222227-project Jun 29 11:46:46.124985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: method: > Jun 29 11:46:46.124985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: exception: Instance 7076be8a-f02b-49f2-9124-c2a539ac2cef could not be found. Jun 29 11:46:46.124985 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: action_args: {'id': '7076be8a-f02b-49f2-9124-c2a539ac2cef'} Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7076be8a-f02b-49f2-9124-c2a539ac2cef could not be found. Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 11:46:46.126041 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7076be8a-f02b-49f2-9124-c2a539ac2cef could not be found. Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7076be8a-f02b-49f2-9124-c2a539ac2cef could not be found. Jun 29 11:46:46.127799 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Jun 29 11:46:46.129480 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4cec1a72-f403-46a8-9d4f-538d8760e582 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Returning 404 to user: Instance 7076be8a-f02b-49f2-9124-c2a539ac2cef could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 11:46:46.129480 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4cec1a72-f403-46a8-9d4f-538d8760e582 tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef" status: 404 len: 111 microversion: 2.1 time: 0.031410 Jun 29 11:46:46.129480 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 627/1255] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jun 29 11:46:46 2022] GET /compute/v2.1/servers/7076be8a-f02b-49f2-9124-c2a539ac2cef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 11:46:46.346898 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-74d96ea5-57a7-4fa0-bd42-c97e01c19a5b tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] Calling method '.version_select at 0x7fd08aa430d0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 11:46:46.447004 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-74d96ea5-57a7-4fa0-bd42-c97e01c19a5b tempest-TestShelveInstance-1363222227 tempest-TestShelveInstance-1363222227-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1576827291" status: 202 len: 0 microversion: 2.1 time: 0.103940 Jun 29 11:46:46.447525 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 629/1256] 10.222.0.44 () {58 vars in 1253 bytes} [Wed Jun 29 11:46:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1576827291 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 11:47:12.402686 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:47:12.403306 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Wed Jun 29 11:47:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:48:07.232730 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:48:07.233461 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Wed Jun 29 11:48:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:49:47.585858 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:49:47.586410 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Wed Jun 29 11:49:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:50:30.375916 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:50:30.376578 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Wed Jun 29 11:50:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:50:32.411958 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:50:32.412554 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Wed Jun 29 11:50:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:51:27.241238 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:51:27.242049 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Wed Jun 29 11:51:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:51:53.202454 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:51:53.203095 dv-cinder-847335-2-iscsi devstack@n-api.service[117921]: Wed Jun 29 11:51:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 11:51:55.322047 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 11:51:55.322653 dv-cinder-847335-2-iscsi devstack@n-api.service[117920]: Wed Jun 29 11:51:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!